Hacker News

jshchnz
Show HN: RateMyPrompt – share and rate prompts with auto AI evals josh.ing

Couldn't find a reliable, free place to share & rate AI prompts so I thought I'd take a stab at it

Already has 500+ prompts generated by AI using the latest model prompting guidelines

5 different supported prompt types: full prompt, enhancement, template, system, chain

20+ categories: coding, writing, marketing, business, creative, etc.

Every prompt gets evaluated automatically by multiple AI models (Claude 3 + GPT-4 Mini, more to come)

Then humans can rate and there is an overall score that takes both AI & humans into account

AI eval prompt here: https://www.josh.ing/ratemyprompt/evaluation-prompt

I'm still quite the noob when it comes to AI stuff so I'd love feedback about RateMyPrompt and ways that it could be improved


andy_ng11 days ago

Love your work, but can you share what criteria these llms use to evaluate prompts and it would be nice if these llms can give feedback on improving these prompts beside giving just a score!

danielrm2613 days ago

Nice! You should integrate with github.com/danielmiessler/fabric!

honorable_coder13 days ago

I see what you are doing there - HLRF for free.

jshchnzop13 days ago

HLRF? do you mean RLHF?

honorable_coder13 days ago

yes yes, i am dyslexic so it shows up a lot more in short responses.

TMSai13 days ago

[dead]

hn-front (c) 2024 voximity
source