• 1 Post
  • 149 Comments
Joined 3 years ago
cake
Cake day: July 5th, 2023

help-circle
  • Driver facing camera systems can be consistent with privacy, as long as they don’t record or transmit any data other than a single dimensional metric of how distracted or drowsy a driver is (or even discrete binary state of yes/no) and timestamps when that state was detected.

    A closed loop system that merely keeps that data for the current drive and maintains it solely in the vehicle’s own systems can be consistent with privacy principles that nobody else should know anything about how a car is being used, except what can be observed from the outside.






  • AI companies are bankrupting themselves with training costs that they need to recoup back by selling inference.

    I think they hit a wall in actual returns on performance with pretraining, years ago. Then they started scaling up on post-training/reinforcement learning to continue improvement, but that might be hitting a plateau as well. More recently it looks like they’re relying more heavily on scaling up on inference, which is a significant problem for their long term business models.

    If they’re not able to cheaply deliver inference (and charge at a premium), how will they be able to sustain their businesses?

    It seems that the most recent, largest models are using a lot more tokens to accomplish the same tasks, so even as token cost drops the actual cost of using the latest models seems to be going up with time (even as performance improves).




  • The only solution is to make sure they can’t read data you don’t want shared.

    Isn’t that the appropriate guardrail, then? LLM chats and agents and whatever need to be contained with external permissions settings that the LLMs simply do not and can never have the power to override.

    In a normal customer service setting with human agents, there are still plenty of examples of what a human agent simply doesn’t have the power to do. Often, they’ll need to escalate to a manager to do things like process refunds not just because they weren’t given social permission to do so, but because they weren’t given technical permissions to do so. LLM agents need to be contained in the same way. Any decent use of agents, human or software, requires carefully designed processes and permissions extrinsic to that agent’s own decisionmaking abilities to make sure that agents don’t do something bad for the company.









  • AI has an interesting economic trait in that it’s very, very expensive to deploy, and made very fast progress from 2022 to 2024. That caused investors with money to believe that:

    • Pushing the frontier was going to cost a lot of money. More than any other purported revolutionary tech.
    • Extrapolation of past improvement meant that whoever was on the cutting edge may end up with a product with a huge paying market.
    • So whoever wins this race would be rich, and the investment would have been worth it for them.

    But since 2024, we’ve seen that the cutting edge got even more expensive much faster than expected, and much of the improvements in performance now come from inference rather than training, which represents a high ongoing cost.

    Now, if we extrapolate from that trend line, we’ll see that the market will be much smaller for AI services at the cost it takes to provide that service, and the question then becomes whether the industry can make its operations cheaper, fast enough to profitably provide a service people will pay for.

    I have my doubts they’ll succeed, and we might just be looking at the industry like supersonic flight: conceptually interesting, technically feasible, but just a commercial dead end because it’s too expensive.




  • Counterpoint: sometimes the best still shot requires a particular moment captured with a particular, consciously arranged setup.

    This interview of a veteran NBA photographer breaks it down of how he only has a single shot per shot because of how he necessarily relies on strobes set up to not distract the players or interfere with the broadcast. As a result, he scouts/studies each player and team so that he knows when the right moment is to actually capture the shot, because he can’t exactly ask players to do it again.

    If you read interviews of Pulitzer photography winners, they’ll often say a lot of the same things: being prepared and being lucky and having that convergence of having incredibly high skill/expertise/understanding of the setting, while being able to capture in every opportunity presented.

    You should capture a lot of photos and examine them to understand how to make them better, and increase your skill level and understand your subject so that you can still optimize for the very best shot possible.