Discussion about this post

User's avatar
Mark's avatar

> The tricky part about any machine learning model is that, when you are iterating through trillions of parameters, even a 99.999% accurate signal will amplify a ton of noise.

Reminds me of Friedrich Hayek's idea about information in The Use of Knowledge in Society. Once you have the full data, it's just a matter of applying logic to find the best strategy. Gathering the data is the hard part.

>In a complex system, profit and loss is about as good as you can get.

I think this is one reason prediction markets are particularly interesting. Check out some of the companies building prediction bots using LLMs like Mantic. Prediction markets need to resolve, so they provide a fairly clean signal, unlike price movements of stocks.

>The philosophy of raising as much money as possible for compute to train as large a model as possible and justify it through “well, the future applications will justify the spend” is not possible if the EWM is constructed properly — because the entire point is that profit is the signal.

If that's the case, how would wacky, out-of-distribution ideas be funded, like the internet or EVs? I'm sure the EWM's search space would've eventually led to the discovery of some signal showing that the internet could be useful, but I would think this would've taken a much longer time to uncover vs. someone saying fuck it and building it out.

3 more comments...

No posts

Ready for more?