A 21-year-old San Jose man was arrested Thursday night on suspicion of fatally shooting a woman while she was walking her dogs in San Leandro, according to police.