• 1 Post
  • 624 Comments
Joined 3 years ago
cake
Cake day: March 22nd, 2024

help-circle




  • I would expect that the bigger problem is going to be the actual movement of chips. They’ll probably to keep the focus on the affair rather than actually interrogating the degree to which sanctions were violated. ā€œTech CEO is a dick to his familyā€ hasn’t exactly ended the career of anyone else so long as the money keeps moving. But given how much the domestic AI push has used hawkishness about China to justify itself there could be real problems keeping congress at bay if it turns into both an anti-AI CEO issue and an anti-China issue.








  • It’s always vague talk about how they need to rearchitect their workflows to better integrate blah blah blah. There’s never a specific model they want to move to or a specific plan or even a single detail about what this should look like other than ā€œmore LLMs!ā€

    I propose the reason for this is that we’ve already seen what this kind of model looks like with Gas Town or whatever he’s calling it now and it’s both blatantly stupid and incredibly expensive so any CTO who honestly tried to move a real company towards that model would laughed out of the room or sued for breach of fiduciary duty.



  • I don’t find myself having nearly as many occasions to make use of them as you do, but I do think that all the misplaced AGI hype makes it hard to evaluate the actually technological advancement that LLMs represent. Like, being able to statistically model language to the degree these things do is neat, and I would be more surprised if it wasn’t possible to use that to do some useful and powerful things. But just like how it’s impossible to separate the underlying math of the cryptocurrency sphere from the ideology of technolibertarian griftocracy, everything that the LLM space has produced is poisoned on some level by millenarian technofascism. Like, the degree to which our economy and culture have been warped by these things is entirely a product of the people who think that they’re going to spit out a God that makes whoever does so first king of the world forever. All the actual useful things people are getting from it are around the edges and happening in spite of the demands to remove guardrails and quality checks and human accountability from these systems. But that doesn’t necessarily mean that the underlying mathematics is without value and can’t be part of good and useful systems in the future. Machine Learning as a whole had already demonstrated the value in automated pattern identification and reproduction in a variety of fields from medical diagnostics to pastry sales.

    Don’t get me wrong, I’m strongly in favor of throwing out all this bathwater even if there might be a baby in there somewhere. I just think that ā€œhard to evaluate independentlyā€ isn’t necessarily the same thing as ā€œwithout value in other contextsā€.