Do you feel that GPT-4 is getting worse?
Mehdi Rifai
32 replies
Recently I found myself being frustrated at GPT-4 and its lack of understanding to simple task like summarize this article from a link. I often get a "I can't accomplish this task".
Do you witness similar situations? How do you cope with it?
Replies
Thomas Hallaran@thomas_hallaran
Objectively it is getting worse!
Share
Yeah - it's gotten a lot worst unfortunately.
😂 exactly it has become like humans.. if I give it a task, it gives me back the same task in a different way
Try Gemini
I've noticed GPT-4 can sometimes stumble on tasks like summarizing from a link, possibly due to the way it processes external content. When I encounter this, I usually extract the key points manually and then ask GPT-4 to summarize based on that information to ensure it stays within its operational parameters.
I've noticed GPT-4 can stumble at times, Mehdi, especially with tasks that require real-time web interaction which it's not designed for. When it hits a snag, I pivot to using it for brainstorming or drafting outlines, leveraging its strengths in creativity and content generation.
I've never used ChatGPT-4, but I believe that its performance will vary depending on individual experiences and expectations. It's also important to consider that newer versions of AI models may still be undergoing refinement and improvement over time.
I've noticed GPT-4 can sometimes stumble on tasks that seem straightforward, likely due to the nuances of language processing or current limitations. When I encounter this, I try to rephrase my request or break down the task into simpler components, which often helps clarify the intent.
I just ask a staff member to get the task done for me because i might just smash the screen if i spent more time on it
Has anyone actually measured performance degradation "objectively" here ? Think response quality vs inference time -- let response quality be something simple that you defined, such as JSON completeness.
Yeah - it's gotten a lot worst unfortunately.
Yes it going very worst
Objectively it is getting worse!
I think it depends a lot on your prompts. Also, due to the updates, slight differences can happen in the outputs for the same prompt.
Even minor things / details can influence your output significantly.
I’ve generated approx 16M words with GPTs in the past 3+ years (including the previous versions), so I got this from first hand experience.
I have been using GPT since when it first commercialized it.
It gets worse, then it gets better.
It comes in cycles.
This is why my team are building our own ML models and fine-tuning it to avoid depending on OpenAI
@atticusli do you plan on commercializing your model?
@mehdi_rifai Yes, we will be launching our product in about a month!
Here is what we have built:
https://try.jobsolv.com/waitlist/
Launching soon!
In terms of, for example, coding tasks, absolutely not; it's fortunately getting better and better.
However, I've noticed that developers have limited ability to check information from links. I believe this was implemented for security purposes. Did you tried to upload an article as attached file?
@nadiaaesty that's what i'm starting to do. Pasting the entire article in he prompt instead of asking to check the link
I eared some people talk about it but i did not feel it. I think in they last update, OpenAi said something about that, and they are working on it
Launching soon!
i really like claude more
Yes, then this last few days it has kicked in.
I can relate to the frustration.