René's URL Explorer Experiment

Title: preference-optimization · GitHub Topics · GitHub

Open Graph Title: Build software better, together

X Title: GitHub

Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Open Graph Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

X Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Opengraph URL: https://github.com

X: github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/topics/:topic_name(.:format)
route-controller	topics
route-action	show
fetch-nonce	v2:f66f7ea1-3f4a-5f25-3dae-7b1239e8adbe
current-catalog-service-hash	82c569b93da5c18ed649ebd4c2c79437db4611a6a1373e805a3cb001c64130b7
request-id	E24A:336B47:3EFB7C0:5684EDB:698CC0FD
html-safe-nonce	48c0a9d2716eb5c6401e1d46c63de5916e480830099b8aafb0d5929170bc20db
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFMjRBOjMzNkI0NzozRUZCN0MwOjU2ODRFREI6Njk4Q0MwRkQiLCJ2aXNpdG9yX2lkIjoiNjY4NzA4MDQ0MTcyNjE1NzA1MyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac	6a08f0d8910e43baf26090ff32f726656ba87659b4767009dcdc722852df05c2
github-keyboard-shortcuts	copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/topics/preference-optimization
og:site_name	GitHub
og:image	https://github.githubassets.com/assets/github-octocat-13c86b8b336d.png
og:image:type	image/png
og:image:width	1200
og:image:height	620
twitter:site:id	13334762
twitter:creator	github
twitter:creator:id	13334762
twitter:card	summary_large_image
twitter:image	https://github.githubassets.com/assets/github-logo-55c5b9a1fe52.png
twitter:image:width	1200
twitter:image:height	1200
hostname	github.com
expected-hostname	github.com
None	640eeb7b6ff4d8d106235d228c0c286e82592d4d2403227b5b2b4fc5832297a4
turbo-cache-control	no-preview
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	3d444f0a47beeeac94cddbb51c91ab408befe8d4
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/topics/preference-optimization#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fpreference-optimization
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fpreference-optimization
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2Ftopics%2Fpreference-optimization&source=header
Reload	https://patch-diff.githubusercontent.com/topics/preference-optimization
Reload	https://patch-diff.githubusercontent.com/topics/preference-optimization
Reload	https://patch-diff.githubusercontent.com/topics/preference-optimization
Explore	https://patch-diff.githubusercontent.com/explore
Topics	https://patch-diff.githubusercontent.com/topics
Trending	https://patch-diff.githubusercontent.com/trending
Collections	https://patch-diff.githubusercontent.com/collections
Events	https://patch-diff.githubusercontent.com/events
GitHub Sponsors	https://patch-diff.githubusercontent.com/sponsors/explore
Star	https://patch-diff.githubusercontent.com/login?return_to=%2Ftopic.preference-optimization
Most stars	https://patch-diff.githubusercontent.com/topics/preference-optimization?o=desc&s=stars
Fewest stars	https://patch-diff.githubusercontent.com/topics/preference-optimization?o=asc&s=stars
Most forks	https://patch-diff.githubusercontent.com/topics/preference-optimization?o=desc&s=forks
Fewest forks	https://patch-diff.githubusercontent.com/topics/preference-optimization?o=asc&s=forks
Recently updated	https://patch-diff.githubusercontent.com/topics/preference-optimization?o=desc&s=updated
Least recently updated	https://patch-diff.githubusercontent.com/topics/preference-optimization?o=asc&s=updated
general-preference	https://patch-diff.githubusercontent.com/general-preference
general-preference-model	https://patch-diff.githubusercontent.com/general-preference/general-preference-model
Star 39	https://patch-diff.githubusercontent.com/login?return_to=%2Fgeneral-preference%2Fgeneral-preference-model
Code	https://patch-diff.githubusercontent.com/general-preference/general-preference-model
Issues	https://patch-diff.githubusercontent.com/general-preference/general-preference-model/issues
Pull requests	https://patch-diff.githubusercontent.com/general-preference/general-preference-model/pulls
https://arxiv.org/abs/2410.02197	https://arxiv.org/abs/2410.02197
alignment	https://patch-diff.githubusercontent.com/topics/alignment
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
rlhf	https://patch-diff.githubusercontent.com/topics/rlhf
preference-modeling	https://patch-diff.githubusercontent.com/topics/preference-modeling
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
sahsaeedi	https://patch-diff.githubusercontent.com/sahsaeedi
TPO	https://patch-diff.githubusercontent.com/sahsaeedi/TPO
Star 30	https://patch-diff.githubusercontent.com/login?return_to=%2Fsahsaeedi%2FTPO
Code	https://patch-diff.githubusercontent.com/sahsaeedi/TPO
Issues	https://patch-diff.githubusercontent.com/sahsaeedi/TPO/issues
Pull requests	https://patch-diff.githubusercontent.com/sahsaeedi/TPO/pulls
alignment	https://patch-diff.githubusercontent.com/topics/alignment
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
rlhf	https://patch-diff.githubusercontent.com/topics/rlhf
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
s-vco	https://patch-diff.githubusercontent.com/s-vco
s-vco	https://patch-diff.githubusercontent.com/s-vco/s-vco
Star 18	https://patch-diff.githubusercontent.com/login?return_to=%2Fs-vco%2Fs-vco
Code	https://patch-diff.githubusercontent.com/s-vco/s-vco
Issues	https://patch-diff.githubusercontent.com/s-vco/s-vco/issues
Pull requests	https://patch-diff.githubusercontent.com/s-vco/s-vco/pulls
alignment-algorithms	https://patch-diff.githubusercontent.com/topics/alignment-algorithms
vision-language-models	https://patch-diff.githubusercontent.com/topics/vision-language-models
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
iBacklight	https://patch-diff.githubusercontent.com/iBacklight
PipelineLLM	https://patch-diff.githubusercontent.com/iBacklight/PipelineLLM
Star 12	https://patch-diff.githubusercontent.com/login?return_to=%2FiBacklight%2FPipelineLLM
Code	https://patch-diff.githubusercontent.com/iBacklight/PipelineLLM
Issues	https://patch-diff.githubusercontent.com/iBacklight/PipelineLLM/issues
Pull requests	https://patch-diff.githubusercontent.com/iBacklight/PipelineLLM/pulls
reinforcement-learning	https://patch-diff.githubusercontent.com/topics/reinforcement-learning
lora	https://patch-diff.githubusercontent.com/topics/lora
fine-tuning	https://patch-diff.githubusercontent.com/topics/fine-tuning
post-training	https://patch-diff.githubusercontent.com/topics/post-training
continual-learning	https://patch-diff.githubusercontent.com/topics/continual-learning
sft	https://patch-diff.githubusercontent.com/topics/sft
rlhf	https://patch-diff.githubusercontent.com/topics/rlhf
llm-reasoning	https://patch-diff.githubusercontent.com/topics/llm-reasoning
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
llm-infrastructure	https://patch-diff.githubusercontent.com/topics/llm-infrastructure
llm-processing	https://patch-diff.githubusercontent.com/topics/llm-processing
Sreyan88	https://patch-diff.githubusercontent.com/Sreyan88
Synthio	https://patch-diff.githubusercontent.com/Sreyan88/Synthio
Star 12	https://patch-diff.githubusercontent.com/login?return_to=%2FSreyan88%2FSynthio
Code	https://patch-diff.githubusercontent.com/Sreyan88/Synthio
Issues	https://patch-diff.githubusercontent.com/Sreyan88/Synthio/issues
Pull requests	https://patch-diff.githubusercontent.com/Sreyan88/Synthio/pulls
audio	https://patch-diff.githubusercontent.com/topics/audio
audio-classification	https://patch-diff.githubusercontent.com/topics/audio-classification
synthetic-data	https://patch-diff.githubusercontent.com/topics/synthetic-data
audio-generation	https://patch-diff.githubusercontent.com/topics/audio-generation
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
RUCKBReasoning	https://patch-diff.githubusercontent.com/RUCKBReasoning
DPO_Text2SQL	https://patch-diff.githubusercontent.com/RUCKBReasoning/DPO_Text2SQL
Star 12	https://patch-diff.githubusercontent.com/login?return_to=%2FRUCKBReasoning%2FDPO_Text2SQL
Code	https://patch-diff.githubusercontent.com/RUCKBReasoning/DPO_Text2SQL
Issues	https://patch-diff.githubusercontent.com/RUCKBReasoning/DPO_Text2SQL/issues
Pull requests	https://patch-diff.githubusercontent.com/RUCKBReasoning/DPO_Text2SQL/pulls
text-to-sql	https://patch-diff.githubusercontent.com/topics/text-to-sql
nl2sql	https://patch-diff.githubusercontent.com/topics/nl2sql
dpo	https://patch-diff.githubusercontent.com/topics/dpo
text2sql	https://patch-diff.githubusercontent.com/topics/text2sql
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
sahsaeedi	https://patch-diff.githubusercontent.com/sahsaeedi
DCPO-T2I	https://patch-diff.githubusercontent.com/sahsaeedi/DCPO-T2I
Star 9	https://patch-diff.githubusercontent.com/login?return_to=%2Fsahsaeedi%2FDCPO-T2I
Code	https://patch-diff.githubusercontent.com/sahsaeedi/DCPO-T2I
Issues	https://patch-diff.githubusercontent.com/sahsaeedi/DCPO-T2I/issues
Pull requests	https://patch-diff.githubusercontent.com/sahsaeedi/DCPO-T2I/pulls
alignment	https://patch-diff.githubusercontent.com/topics/alignment
diffusion-models	https://patch-diff.githubusercontent.com/topics/diffusion-models
rlhf	https://patch-diff.githubusercontent.com/topics/rlhf
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
JIA-Lab-research	https://patch-diff.githubusercontent.com/JIA-Lab-research
TGDPO	https://patch-diff.githubusercontent.com/JIA-Lab-research/TGDPO
Star 9	https://patch-diff.githubusercontent.com/login?return_to=%2FJIA-Lab-research%2FTGDPO
Code	https://patch-diff.githubusercontent.com/JIA-Lab-research/TGDPO
Issues	https://patch-diff.githubusercontent.com/JIA-Lab-research/TGDPO/issues
Pull requests	https://patch-diff.githubusercontent.com/JIA-Lab-research/TGDPO/pulls
alignment	https://patch-diff.githubusercontent.com/topics/alignment
preference-learning	https://patch-diff.githubusercontent.com/topics/preference-learning
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
llm	https://patch-diff.githubusercontent.com/topics/llm
rlhf	https://patch-diff.githubusercontent.com/topics/rlhf
preference-alignment	https://patch-diff.githubusercontent.com/topics/preference-alignment
direct-preference-optimization	https://patch-diff.githubusercontent.com/topics/direct-preference-optimization
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
DtYXs	https://patch-diff.githubusercontent.com/DtYXs
Pre-DPO	https://patch-diff.githubusercontent.com/DtYXs/Pre-DPO
Star 7	https://patch-diff.githubusercontent.com/login?return_to=%2FDtYXs%2FPre-DPO
Code	https://patch-diff.githubusercontent.com/DtYXs/Pre-DPO
Issues	https://patch-diff.githubusercontent.com/DtYXs/Pre-DPO/issues
Pull requests	https://patch-diff.githubusercontent.com/DtYXs/Pre-DPO/pulls
alignment	https://patch-diff.githubusercontent.com/topics/alignment
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
Yellow4Submarine7	https://patch-diff.githubusercontent.com/Yellow4Submarine7
LLMDoctor	https://patch-diff.githubusercontent.com/Yellow4Submarine7/LLMDoctor
Star 2	https://patch-diff.githubusercontent.com/login?return_to=%2FYellow4Submarine7%2FLLMDoctor
Code	https://patch-diff.githubusercontent.com/Yellow4Submarine7/LLMDoctor
Issues	https://patch-diff.githubusercontent.com/Yellow4Submarine7/LLMDoctor/issues
Pull requests	https://patch-diff.githubusercontent.com/Yellow4Submarine7/LLMDoctor/pulls
transformers	https://patch-diff.githubusercontent.com/topics/transformers
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
alignment	https://patch-diff.githubusercontent.com/topics/alignment
lora	https://patch-diff.githubusercontent.com/topics/lora
llm	https://patch-diff.githubusercontent.com/topics/llm
qwen	https://patch-diff.githubusercontent.com/topics/qwen
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
aaai2026	https://patch-diff.githubusercontent.com/topics/aaai2026
test-time-alignment	https://patch-diff.githubusercontent.com/topics/test-time-alignment
vanbelkummax	https://patch-diff.githubusercontent.com/vanbelkummax
bioreasoner	https://patch-diff.githubusercontent.com/vanbelkummax/bioreasoner
Star 0	https://patch-diff.githubusercontent.com/login?return_to=%2Fvanbelkummax%2Fbioreasoner
Code	https://patch-diff.githubusercontent.com/vanbelkummax/bioreasoner
Issues	https://patch-diff.githubusercontent.com/vanbelkummax/bioreasoner/issues
Pull requests	https://patch-diff.githubusercontent.com/vanbelkummax/bioreasoner/pulls
open-science	https://patch-diff.githubusercontent.com/topics/open-science
language-models	https://patch-diff.githubusercontent.com/topics/language-models
dpo	https://patch-diff.githubusercontent.com/topics/dpo
rlhf	https://patch-diff.githubusercontent.com/topics/rlhf
biomedical-nlp	https://patch-diff.githubusercontent.com/topics/biomedical-nlp
llm-training	https://patch-diff.githubusercontent.com/topics/llm-training
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
scientific-reasoning	https://patch-diff.githubusercontent.com/topics/scientific-reasoning
hallucination-reduction	https://patch-diff.githubusercontent.com/topics/hallucination-reduction
scientific-alignment	https://patch-diff.githubusercontent.com/topics/scientific-alignment
pps121	https://patch-diff.githubusercontent.com/pps121
D-STEER	https://patch-diff.githubusercontent.com/pps121/D-STEER
Star 0	https://patch-diff.githubusercontent.com/login?return_to=%2Fpps121%2FD-STEER
Code	https://patch-diff.githubusercontent.com/pps121/D-STEER
Issues	https://patch-diff.githubusercontent.com/pps121/D-STEER/issues
Pull requests	https://patch-diff.githubusercontent.com/pps121/D-STEER/pulls
alignement	https://patch-diff.githubusercontent.com/topics/alignement
ai-alignment	https://patch-diff.githubusercontent.com/topics/ai-alignment
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
martimfasantos	https://patch-diff.githubusercontent.com/martimfasantos
CustomPOs-for-SLMs	https://patch-diff.githubusercontent.com/martimfasantos/CustomPOs-for-SLMs
Star 0	https://patch-diff.githubusercontent.com/login?return_to=%2Fmartimfasantos%2FCustomPOs-for-SLMs
Code	https://patch-diff.githubusercontent.com/martimfasantos/CustomPOs-for-SLMs
Issues	https://patch-diff.githubusercontent.com/martimfasantos/CustomPOs-for-SLMs/issues
Pull requests	https://patch-diff.githubusercontent.com/martimfasantos/CustomPOs-for-SLMs/pulls
nlp	https://patch-diff.githubusercontent.com/topics/nlp
evaluation	https://patch-diff.githubusercontent.com/topics/evaluation
preference-learning	https://patch-diff.githubusercontent.com/topics/preference-learning
human-preferences	https://patch-diff.githubusercontent.com/topics/human-preferences
llms	https://patch-diff.githubusercontent.com/topics/llms
gen-ai	https://patch-diff.githubusercontent.com/topics/gen-ai
preference-optimization	https://patch-diff.githubusercontent.com/topics/preference-optimization
Curate this topic	https://github.com/github/explore/tree/master/CONTRIBUTING.md?source=add-description-preference-optimization
Learn more	https://docs.github.com/en/articles/classifying-your-repository-with-topics
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.