3' X 4' is OK, but you will want more space if you really get into reloading. Make sure the table is very sturdy - heavy with no flex in the table top. Surface should be smooth. Smokeless powder is pretty safe, but it is flammable. Keep a fire extinguisher in the room.
Inspect your brass...