Don't start with a progressive press. It's not a good idea for a beginner.
This is commonly given advice and it does make some sense, but I started with a progressive press and didn't have any problems. If you're patient and mechanically inclined you can figure it out.
I've also heard you should always start with a straight wall case, but I didn't follow that advice either.
Personally I think the most important thing for a beginner is to get some hands on experience before buying a bunch of stuff. Find an INGO member who is a reloader, who will let you work in on a session with them. Or take an NRA reloading class. You can also buy videos or watch them on YouTube - but I think getting some real life experience is most important.
The only other major piece of advice I would give is that most problems come from messing around with loads that are on the extreme ends - either super light loads or super heavy loads. Both can be dangerous. The only time I made a potentially dangerous mistake was a load that was too light (trying to make a super low recoil target load for new shooters). There is also no sense in trying to make the most powerful load you can. The best shooting most accurate load is almost never a max load.
Some advise starting with a very light load then working up. What I do is look at at least 5 different data sources, max and min, and try to find a value that is right in the middle. This is my start load. I will load a test run at this value, and some slightly hotter and some slightly milder. I almost always find something that works super well for me with this procedure.