Three people were injured after a large portion of scaffolding surrounding a downtown Brooklyn building collapsed on Saturday, cops said. The scaffolding — surrounding a Starbucks and close to the Borough Hall subway station at Court and Joralemon streets — came crashing down around 11 a.m., according to police. One construction worker and two pedestrians…