The four states that did not secede from the Union before the start of the Civil War were Arkansas, Tennessee, Virginia and North Carolina. These four states didn't secede until April 12, 1861 which was when the Battle of Fort Sumter took place near Charleston, South Carolina.
