So, now that the AI stack has been de facto cut in half and cloud computing/chips seem less essential, the question that remains is: which data are more important for foundation models? Training data, or user generated data that may create reinforcement effects? Any insights from tech savvy people?
8 months ago