Back to stories
slopgrid.com

Show HN: SlopGrid – Create your own oneshot AI model benchmarks

1points byklntsky1h
This is something I've been playing with for the last couple days - an app I vibecoded to arrange oneshot LLM visual benchmarks without the need to write any code. I do it form my phone so the excellence of mobile UI is high in the priority list.

It is inspired by Simon Willison's benchmark writeups[0], basically you can recreate them in one go.

Besides text and images, it supports SVG outputs and whole static websites, which is where benchmarks get the most interesting.

Additionally, I added the ability to alter chat history for the chat completion API, which I think is useful for model red teaming (or if you just want to see how different models apologize) - but I haven't found any impressive uses of that feature yet.

This thing helped me improve my intuition on different SOTA models' strengths and weaknesses; check out the various examples on the website, and feel free to create your own

[0] https://simonwillison.net/tags/svg/

Comments

0 total · 0 loaded

Ranked by HN
No comments yet.