Mapping Process

In 2020, HEET has developed a new process for generating mappable gas leaks data. This process has resulted in an increase in accuracy and shareable gas leak data that can be imported into any mapping system that can use geocoded data.

The process in overview is as follows:

  • Every February, Annual Service Quality Report (ASQR) data is obtained from MA DPU¬†
  • Repaired, unrepaired and eliminated leaks data is reviewed, selected and extracted from the reports
  • Full leak address data is constructed in preparation for geocoding
  • The leak address data is geocoded
  • All geocoded addresses are reviewed by the HEET mapping team to catch errors in the original utility leak addresses, as well as any issues with the geocoding addresses that occasionally occur
  • Corrected addresses are geocoded again, and any unresolved issues are manually dealt with to identify the best matching location and GPS coordinates
  • Google KML is generated from the corrected and geocoded data and used for creating Google maps for each utility. These utility-level maps are then reviewed by the HEET mapping team to spot and fix any remaining issues such as leak addresses that were outside of their utility
  • The leak data for each town is then automatically extracted from the final geocoded addresses and town re-designation tables are created to cluster small towns into area maps, such as consolidating North/South/East/West towns
  • Using the final geocoded data and town re-designations, KML is generated to update the HEET gas leaks maps. In the case of Boston specific towns, KML is generated based on matching ZIP codes rather than towns.
  • The final geocoded data is also used to create shareable data files by utility and by town. We share this data under a Creative Commons license. Please contact us directly if you want a copy of the data.

Data Sources

Worksheet nameDPU docket #Docket data source
Berkshire Gas - repaired20-SQ-02BGC_SQ_Report_for_2019_ 2-28-2020.xlsx - worksheet "Appx D - Gas Leak Class Data" - leaks with a 'repair date'
Berkshire Gas - unrepaired20-SQ-02BGC_SQ_Report_for_2019_ 2-28-2020.xlsx - worksheet "Appx D - Gas Leak Class Data" - leaks without a 'repair date'
Columbia Gas - repaired20-SQ-01Sec 4 - CMA Annual Leak Report 2019.xlsx - column '"Status at end of year" is 'Repaired', or 'Eliminated by Replacement'
Columbia Gas - unrepaired20-SQ-01Sec 4 - CMA Annual Leak Report 2019.xlsx - column '"Status at end of year" is 'Pending'
Columbia Gas - eliminated-GSEP20-SQ-01Sec 4 - CMA Annual Leak Report 2019.xlsx - column '"Status at end of year" is 'Eliminated by Replacement'
Columbia Gas - eliminated otherwise20-SQ-01Sec 4 - CMA Annual Leak Report 2019.xlsx - column '"Status at end of year" is 'Eliminated Otherwise'
Fitchburg - repaired20-SQ-04p42. 2019_MA_Leaks_02112020.xlsx - column "Status at End of Year" is 'Repaired'
Fitchburg - unrepaired20-SQ-04p42. 2019_MA_Leaks_02112020.xlsx - column "Status at End of Year" is 'Pending'
Fitchburg - eliminated20-SQ-04p42. 2019_MA_Leaks_02112020.xlsx - column "Status at End of Year" is 'Eliminated'
Eversource - repaired20-SQ-09App_5_2019_Eversource_SQI_Section_144(e)_data.xlsx - worksheet 'Eversource Leaks Repaired 2019'
Eversource - unrepaired20-SQ-09App_5_2019_Eversource_SQI_Section_144(e)_data.xlsx - worksheet 'Existing Leaks as of 12-31-19'
Eversource - eliminated-GSEP20-SQ-09App_5_2019_Eversource_SQI_Section_144(e)_data.xlsx - worksheet 'Eversource Leaks Eliminate 2019'
Liberty Utilities - repaired20-SQ-08Liberty-2019_Gas_Leaks_Report_Repaired.xlsx contains one worksheet, with a list of leaks repaired in 2019
Liberty Utilities - unrepaired20-SQ-08Liberty-Utilities-Initial_Filing.pdf - pages 15-23 lists the active leaks ie unrepaired
National Grid - Boston Gas - repaired20-SQ-05Boston_Gas_2019_SQ_Report_2-28-2020.xlsx - worksheet "9.Repaired Leaks"
National Grid - Boston Gas - unrepaired20-SQ-05Boston_Gas_2019_SQ_Report_2-28-2020.xlsx - worksheet "10.Open Leaks"
National Grid - Colonial Gas - repaired20-SQ-06Colonial_Gas_SQ_Report_CY_2019.xlsx - worksheet "9.Repaired Leaks"
National Grid - Colonial Gas - unrepaired20-SQ-06Colonial_Gas_SQ_Report_CY_2019.xlsx - worksheet "10.Open Leaks"