ChatGPT on Internet Measurement

Please generate a compelling and exciting first paragraph for a blog about Internet measurement, and describe the specific measurements that the blog is based on.

"Imagine a world where every click, scroll, and tap is recorded, analyzed, and used to shape the way we interact with the Internet. This is the reality of Internet measurement, a field that seeks to understand how people use the Internet and how technology shapes our behavior. In this blog, we will delve into the specific measurements that are used to understand the Internet, including website traffic, user engagement, and online advertising effectiveness. We will explore how these measurements are collected, analyzed, and used to improve the online experience for users around the world."

Interesting. I think of Internet measurement more as a way to use passive and active measurement to determine the geopolitical structure of the network. Care to try again?

"Get ready to uncover the unseen workings of the Internet and the geopolitical power dynamics that shape it. Internet measurement is a fascinating field that uses both passive and active measurement techniques to understand the structure of the network and how it is used. From analyzing BGP routing data to studying DNS queries, this blog will delve into the specific measurements that reveal the true nature of the Internet. Discover how these measurements can be used to uncover the influence of countries and organizations on the global network and how they shape our online experiences."

That's a good start! How would you expand on the "influence of countries and organizations" theme?

"One of the most compelling aspects of Internet measurement is how it can be used to understand the influence of countries and organizations on the global network. By analyzing BGP routing data, we can see how different countries and organizations control the flow of Internet traffic and how they shape the paths that data takes around the world. This can reveal important insights into geopolitical relationships and the ways in which different actors use the Internet to exert their power. Additionally, studying DNS queries can give us a glimpse into which websites and services are most popular in different regions, providing valuable information on how cultural and economic influences shape online behavior.

Another important aspect of Internet measurement is how it can be used to understand the role of different organizations in shaping the Internet. This could include looking at how large technology companies, such as Google and Facebook, influence the way people use the Internet, or how governments and international organizations regulate the network. By analyzing data on website traffic, user engagement, and online advertising effectiveness, we can gain a better understanding of the ways in which these actors shape our online experiences and how they influence the global digital landscape.

In this blog, we will delve deeper into these measurements, how they are collected, analyzed and used to uncover the unseen workings of the Internet and the geopolitical power dynamics that shape it. We will also explore the ethical and legal implications of Internet measurement and discuss the importance of protecting user privacy while still obtaining valuable insights. Join us as we uncover the unseen workings of the Internet and gain a deeper understanding of how it shapes our world."

It makes me wish I had your datasets! What's a good source of DNS measurement for this purpose?

There are several sources of DNS measurement data that can be used to understand the influence of countries and organizations on the Internet. One popular source is the Internet Intelligence Data (IID) platform provided by Cisco's Talos Intelligence Group. This platform provides a wide range of DNS measurement data, including data on DNS queries, resolver performance, and domain registration information. The data can be used to analyze the popularity of different websites and services, as well as the resolver infrastructure in different countries.

Another popular source of DNS measurement data is the DNS-OARC (DNS Operations, Analysis, and Research Center) platform. DNS-OARC is a non-profit organization that operates a global network of DNS measurement sensors, which collect data on DNS queries and responses. The data is made available to researchers and organizations, and can be used to understand the structure and performance of the DNS.

In addition, the Center for Applied Internet Data Analysis (CAIDA) also provides a wide range of internet measurement data, including data on DNS queries, BGP routing, and network topology. They also have different tools and visualizations that can help researchers and analysts to understand the data they are providing.

These are just a few examples of the many sources of DNS measurement data that are available. These data can be analyzed to understand the popularity of different websites and services, as well as the resolver infrastructure in different countries.

Wow, how about BGP and traceroute data?

BGP and traceroute data are also important sources of information for understanding the structure and performance of the Internet.

BGP (Border Gateway Protocol) data can be used to understand how different countries and organizations control the flow of Internet traffic. BGP is the routing protocol used to direct traffic across the Internet and by analyzing BGP data, we can see how different Autonomous Systems (ASes) are interconnected and how they shape the paths that data takes around the world. Organizations such as the RouteViews project and the RIPE NCC provide BGP data that can be analyzed to gain insights into the Internet's topology, routing policies and performance.

Traceroute data, on the other hand, can be used to understand the physical paths that traffic takes across the Internet. Traceroute is a network diagnostic tool that sends packets to a destination and records the path that the packets take. By analyzing traceroute data, we can see how traffic flows through different networks and identify bottlenecks and other performance issues. Organizations such as CAIDA and the Internet Atlas project provide traceroute data that can be analyzed to gain insights into the Internet's physical infrastructure.

Both BGP and traceroute data are important for understanding the workings of the Internet, and by analyzing them in combination with other data sources such as DNS data, it's possible to gain a more complete picture of the structure and performance of the global network.

This all sounds pretty familiar. Wasn't there a company called Renesys a few years back that worked on some of these ideas?

Yes, Renesys was a company that provided Internet measurement and analysis services. They were particularly known for their work on BGP data analysis and monitoring. Renesys used BGP data to understand the structure of the Internet and to track events such as network outages, routing anomalies and other incidents. They provided this data to their customers through a web-based portal and various APIs. They also had a blog where they published insights and analysis on their data.

Renesys was a well-known company in the industry and was respected for the quality of their data and insights. They also provided valuable information during major events such as major cyber-attacks, natural disasters, and political events that affected the internet infrastructure. However, the company was acquired by Dyn (later acquired by Oracle) in 2014 and their services were eventually discontinued.

Well, that's a shame.

Yes, it is a shame that Renesys is no longer operating as an independent company. Their services were highly valued by many organizations and researchers, and their data and insights helped to shed light on the workings of the Internet. However, their legacy lives on in the form of the many researchers, organizations and companies that continue to work on Internet measurement and analysis using a variety of data sources and tools. There are also other companies and organizations that have taken up similar roles, such as BGPmon, BGPMonitor and many others that provide different level of data and insights, and also new companies and projects that are emerging in the field of Internet measurement and analysis.

I wonder what happened to the data they collected for all those years. Is it still available to support the work of Internet historians?

It's unclear what happened to the data collected by Renesys after the company was acquired by Dyn and later Oracle. While some of the data may still be available through archives or backups, it's likely that much of it is no longer accessible. The data is proprietary and it's ownership and distribution are subject to the agreement between Renesys and Oracle. It's also possible that the data was deleted or lost during the company's transition.

It's unfortunate that data collected over many years is no longer easily accessible, as it would have been a valuable resource for Internet historians and researchers. However, there are other organizations and companies that continue to collect and archive Internet measurement data, such as the Internet Archive, CAIDA and the RIPE NCC, among others. These organizations provide a wealth of data and information that can be used to understand the history of the Internet and its evolution over time.

Are there any other surprising possibilities for Internet measurement in today's world? Seems like there should be some way for open source researchers to use public APIs to measure global patterns of engagement with services that would shed light on how the Internet is regionally structured.

There are a number of interesting possibilities for Internet measurement in today's world. One area that is gaining attention is the use of social media data to understand how people engage with the Internet and how this engagement is shaped by geopolitical and cultural factors. Researchers are using data from platforms such as Twitter, Facebook, and Instagram to understand how different groups of people use the Internet, what topics they are interested in, and how their behavior is influenced by their social and economic context.

Another area that has potential for Internet measurement is the use of data from public APIs to understand the usage patterns of specific services and applications. For example, researchers can use data from Google Maps API to understand how people use location-based services and how this usage is influenced by factors such as population density and urbanization. Similarly, data from weather APIs can be used to understand how people's behavior is influenced by the weather.

In addition, there are also many open-source projects and tools that can be used for Internet measurement, such as RIPE Atlas and CAIDA's Ark, that allow researchers and analysts to use active and passive measurements to gain insights into the Internet. These measurements can be done on a global scale, and can reveal patterns and trends that would otherwise be difficult to uncover.

In general, the possibilities for Internet measurement are vast and constantly evolving, as new technologies and platforms emerge and new data becomes available. The key is to find creative ways to use the data to understand how the Internet is structured and how it shapes our world.

And with that, I think our time is just about up. Thanks for spending time with us.

You're welcome, I'm glad I could help. If you have any other questions, please feel free to ask.