To an LLM, facts are just text like anything else, and it doesn't differentiate absent fine tuning. But while fine tuning has shown increasingly good results with coding, math, and tool following, it hurts creativity, which is bad for writing. I don't think there's a way out.
add a skeleton here at some point
5 months ago