Lately, I have been experimenting with how to feed context into GPT models more effectively.
For example, when fine-tuning or working with larger context windows, I have noticed that the dilemma is in organizing the surrounding information, rather than the prompt itself. Last week, I came to know that it's called Context Engineering.
