'Little House on the Prairie' star Melissa Gilbert left LA because it wasn't a 'safe place' for her to age