I'd probably avoid taking technology as I've heard that magic does strange stuff to it...the best thing I could take is maybe a knife or a firearm for immediate defense (would only have 15-25 bullets, but hopefully I would rarely need it). Maybe I could take a printed book on quantum physics or something and sell it as some rare preserved Dwemer Relic. Nevermind that it's written in Tamrielian, the Dwemer had some mad foresight.
I would probably join up with the Mage's or Fighters Guild to find a steady job to get involved in. More likely, it would be the Mage's Guild. The Fighter's Guild is all about fighting and is pretty dangerous, but the mages tend to relax and mostly do research instead of a lot of fighting.
The huge issue is the cost of entrance though. Magic is expensive - and to get into the Mage's Guild, you have to travel all across Cyrodiil to pass the guild's tests - and traveling is really expensive.
As an alternative I could probably just find Sinderion and help him find his Nirnroots. It doesn't really involve fighting, just looking around rivers to find strange plants. (Once again, it's a lot of traveling though). I could sell the potions he gives me for a pretty Septim and make enough money to get started with joining the Mage's Guild - and maybe in my travels I'll get more Nirnroots for him.
Last resort: Join the Imperial Legion. A soldier's life is tough but at least you get cool armor and decent pay.
Or...I could claim myself a scholar, a stranger with a strange amount of wisdom about the planes of oblivion, the daedra, the aedra, and the future. Get myself in a college somewhere, maybe as a teacher.