Aly was born in Lerwick, Shetland in 1946 and grew up in the islands. He began playing the fiddle at the age of eleven, learning from Tom Anderson, the acknowledged master of Shetland traditional music. After several years playing locally in Shetland Aly headed south to mainland Scotland and life as a full-time musician. His dramatic playing, with great tone and technical ability, brought early recognition.