Avi was born in New York City in 1937. He grew up in a family of readers, writers, and artists. His twin sister, who gave him the nickname "Avi" at an early age, also became a writer.