Data Duplication Bug in M-Lab BigQuery Data
The team working on archiving M-Lab data recently discovered that the M-Lab data hosted in BigQuery was affected by a bug that caused duplicates to appear in our dataset. Queries against M-Lab’s BigQuery dataset performed between May 2014 and April 2015 were impacted. The raw files in our Google Cloud Storage bucket were not.
Categories
- Visualization (8)
- Data analysis (7)
- Ripe (4)
- Gsoc (1)
- Open source (5)
- Research (44)
- Interconnection (6)
- Consumer internet (2)
- Performance (15)
- Tos (1)
- Observatory (5)
- Features (1)
- Data (55)
- Transparency (2)
- Bigquery (22)
- Gcs (2)
- Microbursts (3)
- Switch discard (3)
- Platform (19)
- Dataviz (1)
- Tcp (1)
- Bbr (5)
- Traffic congestion (1)
- Paris traceroute (3)
- Pipeline (5)
- Upgrades (2)
- Virtualization (1)
- Kernel (5)
- Tcp-info (8)
- Web100 (2)
- Bug (3)
- Versioning (1)
- Event (12)
- Community (36)
- Neubot (2)
- Igf (1)
- Paris-traceroute (3)
- Open-source (4)
- Speed (3)
- Accuracy (1)
- Broadband (1)
- Mapping (1)
- Data-analysis (4)
- Schema (3)
- Policies (1)
- Gdpr (1)
- Privacy (3)
- Ndt-server (4)
- Ndt (20)
- Traceroute (7)
- Digital inclusion (2)
- Survey (1)
- Covid19 (5)
- Developer (1)
- Ndt7 (7)
- Gis (1)
- Roadmap (1)
- Wehe (1)
- Policy (1)
- Advocacy (1)
- Murakami (1)
- Ookla (2)
- Latency (1)
- Bufferbloat (1)
- Responsiveness (1)
- Governance (1)
- Experiment review committee (1)
- Fellowship (4)
- Announcement (9)
- Statistics (1)
- Tutorial (2)
- Annotations (1)
- Cloud (2)
- Guest (1)
- Hackathon (1)
- Leadership (2)
- Partnership (1)
- Aim (1)
- Cloudflare (1)
- Ndt5 (1)
- Learning (2)
- Analysis (2)
- Wehe (1)
- Bigquery (1)
- Annual-review (1)
- Internet quality (2)
- Infrastructure (1)
- Contribution (1)
- Censorship measurement (2)
Archive
- October 2024 (1)
- August 2024 (1)
- June 2024 (2)
- March 2024 (2)
- January 2024 (1)
- December 2023 (1)
- September 2023 (1)
- August 2023 (1)
- July 2023 (2)
- June 2023 (2)
- May 2023 (1)
- April 2023 (2)
- January 2023 (1)
- November 2022 (1)
- September 2022 (2)
- August 2022 (2)
- July 2022 (3)
- June 2022 (2)
- May 2022 (1)
- March 2022 (2)
- February 2022 (6)
- January 2022 (3)
- December 2021 (1)
- November 2021 (1)
- October 2021 (1)
- August 2021 (1)
- July 2021 (2)
- June 2021 (1)
- March 2021 (3)
- February 2021 (2)
- January 2021 (1)
- November 2020 (1)
- September 2020 (2)
- August 2020 (2)
- July 2020 (4)
- May 2020 (4)
- April 2020 (4)
- March 2020 (1)
- January 2020 (2)
- December 2019 (1)
- November 2019 (1)
- October 2019 (3)
- September 2019 (1)
- August 2019 (1)
- July 2019 (3)
- June 2019 (1)
- May 2019 (1)
- April 2019 (2)
- March 2019 (5)
- February 2019 (2)
- January 2019 (1)
- November 2018 (1)
- October 2018 (2)
- September 2018 (1)
- July 2018 (3)
- April 2018 (1)
- February 2018 (1)
- January 2018 (2)
- August 2017 (1)
- May 2017 (1)
- April 2017 (1)
- March 2017 (1)
- November 2016 (1)
- October 2016 (1)
- May 2016 (1)
- March 2016 (1)
- January 2016 (1)
- June 2015 (1)
- April 2015 (1)
- February 2015 (1)
- November 2014 (2)
- October 2014 (2)
- March 2014 (2)
- November 2013 (1)
- September 2013 (1)
- August 2013 (1)