NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
Show HN: I built a tiny LLM to demystify how language models work (github.com)
ordinarily 27 minutes ago [-]
It's genuinely a great introduction to LLMs. I built my own awhile ago based off Milton's Paradise Lost: https://www.wvrk.org/works/milton
cbdevidal 11 minutes ago [-]
> you're my favorite big shape. my mouth are happy when you're here.

Laughed loudly :-D

xantronix 7 minutes ago [-]
I fucking hate LLMs as a matter of principle.

However.

I love this. It's so tiny. And cute. It's just a little guy.

nullbyte808 1 hours ago [-]
Adorable! Maybe a personality that speaks in emojis?
SilentM68 1 hours ago [-]
Would have been funny if it were called "DORY" due to memory recall issues of the fish vs LLMs similar recall issues :)
AndrewKemendo 2 hours ago [-]
I love these kinds of educational implementations.

I want to really praise the (unintentional?) nod to Nagel, by limiting capabilities to representation of a fish, the user is immediately able to understand the constraints. It can only talk like a fish cause it’s very simple

Especially compared to public models, thats a really simple correspondence to grok intuitively (small LLM > only as verbose as a fish, larger LLM > more verbose) so kudos to the author for making that simple and fun.

dvt 59 minutes ago [-]
> the user is immediately able to understand the constraints

Nagel's point was quite literally the opposite[1] of this, though. We can't understand what it must "be like to be a bat" because their mental model is so fundamentally different than ours. So using all the human language tokens in the world can't get us to truly understand what it's like to be a bat, or a guppy, or whatever. In fact, Nagel's point is arguably even stronger: there's no possible mental mapping between the experience of a bat and the experience of a human.

[1] https://www.sas.upenn.edu/~cavitch/pdf-library/Nagel_Bat.pdf

AndrewKemendo 47 minutes ago [-]
Different argument

I’m not going to argue other than to say that you need to view the point from a third party perspective evaluating “fish” vs “more verbose thing,” such that the composition is the determinant of the complexity of interaction (which has a unique qualia per nagel)

Hence why it’s a “unintentional nod” not an instantiation

Morpheus_Matrix 1 hours ago [-]
[dead]
weiyong1024 48 minutes ago [-]
[dead]
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 03:24:49 GMT+0000 (Coordinated Universal Time) with Vercel.