“They would have bands and things like that down there and I remember an African lady coming out of the Albany and telling us to go, go home, and we weren’t doing anything; I remember her smoking and she flicked the cigarette on the floor and we stuck our fingers up and ran off down the road. I was scared because I was thinking, I wonder if one of my mum's friends saw me and found out, how hysterical… Because my mum took my picture around to everybody and told them if they see me out they should send her home, we didn’t have mobile phones at the time. The Albany became another hot spot for us”.

- Natasha Ricketts

Since originally opening on Deptford Creek Road, The Albany has been a centre for arts and culture in South East London celebrating Black, African, and Caribbean performing arts. Over the years, the Albany has specifically play a role in promoting Caribbean performance art, through figures like Beverly Glean, who served as a development officer in 1985 and later founded Irie! dance theatre which now operates from the Moonshot.

In the late 1970s, alongside racist attacks in other areas of the borough, the Albany also became a centre for anti-racist activism, hosting numerous events like Rock Against Racism benefits, festivals, and theatre shows. The Albany was destroyed by fire on July 14, 1978, in what many suspected was an arson attack, although the police ruled it accidental. This was similar to other racially motivated incidents in the local area, including the arson of the Moonshot Club and the New Cross Fire. Following the fire, the Albany was rebuilt and relocated to Douglas Way, where it continues to serve as a leading arts centre in South East London.

In the 2000s, Voluntary Action Lewisham (VAL) hosted activities, events and conferences at the Albany to support the local black community, Voluntary Sector and Community Networks. In 2020, Lewisham Council initiated a merger between VAL and Metro, an equality and diversity charity, however, a MetroVAL board was never formed and instead, VAL was shut down and its responsibilities were divided between other local organisations.