Browsed Hugging Face, found a good model with fewer parameters, thought it would be simple enough to run locally, downloaded it, and then realised the actual difficulty starts after that. Not sure how many people have faced this, but the model is usually not the first blocker. The setup is.
You start with one simple goal: run the model and see how it works. But suddenly you are dealing with Python versions, virtual environments, PyTorch installation, CUDA confusion, GPU not being detected, missing packages, memory limits, and random errors that are hard to understand when you are still new to AI.
And this is where the learning flow breaks. A lot of engineers are curious about AI. They do not want to become ML researchers on day one. They just want to explore how things work under the hood. Run a model, change the input, see the output, understand the pipeline, and learn by experimenting.
But instead of sitting in the driver s seat, they are first asked to assemble the entire car.