I would start with breadboards and modules from SparkFun or Adafruit. You can mock up a lot of functionality without needing to solder anything. If you get to the point where you're ready to jump into PCB design, check out the /r/printedcircuitboard wiki: https://www.reddit.com/r/PrintedCircuitBoard/wiki/index/. You might be able to find similar projects that have been posted and critiqued there already. SparkFun and Adafruit both publish their schematics/PCB layouts. I recommend KiCad for your PCB/schematic software - there are plenty of KiCad tutorials and guides on Youtube. Have fun!
Assuming you mean digital circuitry (99% of what's built today), I second the Adafruit recommendation. Sparkfun has good stuff but their focus is more on experimenters whereas Adafruit focuses on education. Their tutorials are very well done, and their hardware is much better "polished" than Sparkfun.
I point out to people that it's clear that Adafruit is noticeably more expensive than the cheap stuff on amazon, but the fact that you can buy something from them, follow the tutorial on it and basically expect everything to work right off the bat makes the cost worth it. Even as a professional embedded developer, I go straight to them when I need to build a prototype and don't want to waste time faffing around.