• 0 Posts
  • 232 Comments
Joined 1 year ago
cake
Cake day: June 4th, 2023

help-circle



  • I’m not familiar with the term “beam” in the context of LLMs, so that’s not factored into my argument in any way. LLMs generate text based on the history of tokens generated thus far, not just the last token. That is by definition non-Markovian. You can argue that an augmented state space would make it Markovian, but you can say that about any stochastic process. Once you start doing that, both become mathematically equivalent. Thinking about this a bit more, I don’t think it really makes sense to talk about a process being Markovian or not without a wider context, so I’ll let this one go.

    nitpick that makes communication worse

    How many readers do you think know what “Markov” means? How many would know what “stochastic” or “random” means? I’m willing to bet that the former is a strict subset of the latter.











  • We’re not at a point yet where this is a concern, so still on the brainstorming phase of how to do this.

    I think the main concern I have is the addictive side of the internet that’s enabled by their recommendation systems and infinite scrolling, so that’s what I would try to block. For example, allow free reign on YouTube, but you have to specifically search for what you want to see.

    There’s also the question of privacy, and whether we should be keeping track of and checking their browsing histories. I’m currently leaning towards yes, while also making sure that they’re aware of what we’re doing. There’s value in letting them make their own mistakes and learning from them, but that only applies to things that they can learn and easily recover from.







  • Maybe chickpeas are expensive where you live, or maybe you miscalculated. Either way, take a look at my numbers for comparison.

    We can get a 3.63kg bag of chickpeas here for $7.49 (CAD). Assuming you fulfill all your Calorie and protein needs from chickpeas alone (2500 Calories and 150g protein per day), it comes out to about $600/year. That’s $1.64/day. In order to be $10/day, you’d have to pay 6x as much for your chickpeas, so that same 3.63kg bag would have to cost $45.50.