optimize_anything: A Universal API for Optimizing any Text Parameter
Paper • 2605.19633 • Published • 6
Pulmo - The AI Radiology Assistant PRO
pulmo
AI & ML interests
CXR's, Biology, ML, and Open Source Software
Recent Activity
liked a model 7 days ago
onnx-community/Carbon-500M-ONNX upvoted a paper 7 days ago
optimize_anything: A Universal API for Optimizing any Text Parameter reacted to salma-remyx's post with 👍 7 days ago
Just trained a 2B coding model to rank candidate AI/ML research ideas against the implicit preferences in a code repository's merge history.
The training data comes from a Gaussian Process fit on the accumulated dispositions in VQASynth, where each PR against a deployed project yields a pairwise comparison between the feature branch preferred and the baseline at main.
The GP scores candidate papers to synthesize preference pairs, and DPO with LoRA bakes the ranking pipeline into the model's weights.
After 1 epoch the model reaches 87.4% reward accuracy on the held-out eval split against 92.3% on training, consistent with learning the task without overfitting.
Now, I'm scaling the pipeline to thousands of repos for a generalization test.
Dataset: https://huggingface.co/datasets/remyxai/mhpd-dpo-v0
Model: https://huggingface.co/remyxai/mhpd-dpo-qwen3.5-2b-vqasynth
Substack: https://remyxai.substack.com/p/the-ai-pmOrganizations
upvoted a paper 7 days ago