As the Sikh population in the Bay Area began growing rapidly, so did the need for a Gurdwara which is integral to any Sikh community. Initially, there were no funds available but despite the hardships, the community pulled together and began renting a community center in the East Bay which opened in 1984. Amongst the founders were Jit Singh Bainiwal (Late), Pyara Singh Obhi (Late) and Teja Singh. As the community began to come together, the committee purchased a small building in East San Jose in 1986. The White Road Gurdwara became even more popular with the community and it was apparent within a few months that the congregation would quickly outgrow the small Gurdwara. 

In 1990, the Gurdwara Committee purchased it's first parcel of land at Quimby Road. Over the next few years, they continued to buy two adjacent parcels which brought the total land owned by the Gurdwara and community to about 5 acres. Around 1993, the Gurdwara Committee realized it would be too expensive to build a Gurdwara there due to tight City and County requirements. In 1996, the Gurdwara Committee decided to buy 40 acres of land near East San Jose Foothills. To build a Gurdwara at this new site, the the committee needed to raise funds of at least $10 million. The Sangat (congregation) were requested to donate generously and give personal loans to the Gurdwara where possible. With the Grace of the Almighty, the community gave overwhelmingly and extended support to the committee. Once funds were raised, construction started on this land in 1999 and Phase 1 of the new Gurdwara project was completed in August 2004. The construction of Phase 2 was completed in April 2011 with a cost of $20 million.