

It shocks me that so many people are just blindly downvoting a comment like this. They make a very testable claim, and even cite a specific, easily searchable person, as their source. If you think the claim is unreasonable, it’s very easy to ask them for more background info or sources, preferably while pointing out why you’re sceptical.
To me, the claim that 16-20 year olds that are full to the brim of hormones, and have had less time to be exposed to various pollution than 30-somethings are more fertile seems reasonable off the bat. I have no doubt that I would have become a parent at 18 if it weren’t for contraceptives, yet I’m now closer to 30 and haven’t become a parent despite trying for a while. One side of that is that at 18 you’re more likely to be constantly pounding like bunnies, another side is that stress, pollutants, and probably a whole host of other factors make you less fertile with age.






You’re absolutely right about that, and if we’re able to build a model that’s as capable as GPT and friends at parsing natural language, without simultaneously training it on everything from poetry to programming, that’s a major win. My current understanding of the field is that in order to build/train the models that are able to robustly parse natural language and “understand” the intent behind a series of instructions well enough to translate them to the correct tool calls, we need a very large and varied training set. I’m using “generalist” as a term to refer to the models that you can interact with in natural language across a wide variety of tasks. Those models are extremely powerful if you can also connect them to tools that solve problems deterministically, so that you get around the problem that they don’t really “understand” anything at all, while taking advantage of the fact that they’re extremely well suited for translating natural language to a selected set of pre-defined actions.
I think a major challenge going forward is that interpreting natural language requires a large set of training data. So training specialised models that can also interact with natural language is by nature difficult.