There were no regulations on buying and selling arsenic until 1851, and even then it could be relatively easy purchased by anyone who didn’t cause any suspicion. 

You can read more on arsenic and other poisons in The Secret Poisoner: The Victorian Age of Poisoning.