{"id":21536,"date":"2018-08-27T22:25:25","date_gmt":"2018-08-27T22:25:25","guid":{"rendered":"http:\/\/ci027cfe6ec0052697"},"modified":"2018-08-27T22:25:25","modified_gmt":"2018-08-27T22:25:25","slug":"democratizing-data-bringing-data-harvesting-and-analytics-masses","status":"publish","type":"post","link":"https:\/\/bitcoinmagazine.com\/press-releases\/democratizing-data-bringing-data-harvesting-and-analytics-masses","title":{"rendered":"Democratizing Data: Bringing Data Harvesting and Analytics to the Masses"},"content":{"rendered":"<div id=\"bsf_rt_marker\"><\/div><figure><img decoding=\"async\" src=\"https:\/\/bitcoinmagazine.com\/wp-content\/uploads\/2024\/11\/democratizing-data-bringing-data-harvesting-and-analytics-to-the-masses.jpg\" title=\"\"><\/figure>\n<p>To date, access to this kingmaking power is very unequal. It has been concentrated in the hands of a select few companies, most of which were already quite powerful to begin with. They alone possess the enormous resources required to collect quality data and turn it into value.&nbsp;<\/p>\n<p>Meanwhile, the rest of the world is drowning in data, but that data and the power it confers remain out of our reach. By extension, the ability to leverage that data in ways that maximize its potential for serving the collective good of society as a whole is limited.<\/p>\n<p>Fortunately, that is now changing. New means of providing access to data, as well as novel tools for correlating data, contextualizing data and analyzing data in real time, promise to usher in an age of democratized data.&nbsp;<\/p>\n<p>In this article, Flux provides a look at how data is being democratized. It focuses on the specific use case of collecting and analyzing environmental data, although the trends discussed below have the potential to play out anywhere that data leads to insight.&nbsp;<\/p>\n<p><strong>The Challenges of Data Democratization<\/strong><\/p>\n<p>In theory, anyone can collect data or access the various open data sets that are collected by government agencies and other organizations committed to open data.<\/p>\n<p>Anyone can theoretically analyze and process data, too; after all, most of the major frameworks for big data processing, like Hadoop and Spark, are open source. There&#8217;s no technical or legal barrier stopping someone from downloading and running them.&nbsp;<\/p>\n<p>At a practical level, however, actually collecting, transforming, storing and\/or analyzing data on a large scale is unfeasible for most individuals and organizations today. That&#8217;s true for a number of reasons:<\/p>\n<ul>\n<li><strong>Data is<br \/> harvested at high, broad levels<\/strong>. Most open-access environmental data sets focus on broad regions.<br \/> If you want to study a particular place or microclimate, it can be hard to<br \/> find the data you need. And while you could theoretically collect the data<br \/> yourself, deploying and managing your own sensors or other data collectors<br \/> is often not realistic because of a traditional lack of affordable, open<br \/> data sensors.<\/li>\n<li><strong>Data may<br \/> be biased<\/strong>. Even<br \/> if you have access to raw open-access data, you can\u2019t be certain that the<br \/> data is not presented in ways that skew your ability to interpret it<br \/> accurately or fairly.<\/li>\n<li><strong>Data<br \/> storage is expensive<\/strong>. Sure,<br \/> you can now store data in the public cloud for just pennies per gigabyte.<br \/> But when your data sets reach terabytes in size, those costs add up and<br \/> few organizations have the budget to sustain them over the long term. (And<br \/> if you don&#8217;t collect data over the long term, you are likely to miss out<br \/> on important insights, especially in contexts like environmental data<br \/> where change typically <a href=\"https:\/\/www.ecologyandsociety.org\/vol18\/iss4\/art68\/\" target=\"_blank\" rel=\"noopener\">results from infrequent,<br \/> sudden events<\/a>.)<\/li>\n<li><strong>Pre-collected<br \/> data is outdated data<\/strong>. If you<br \/> rely on data that was collected by someone else, chances are that the data<br \/> will be stale by the time you access it. Plus, it will take you more time<br \/> to transform the data, clean up data-quality issues and run analysis. By<br \/> the time all of this is done, the insights you can glean from the data may<br \/> be outdated. The only way to solve these problems is to collect and analyze<br \/> data in real time, but again, most organizations lack the resources to do<br \/> this on their own.<\/li>\n<li><strong>Lack of<br \/> data interpretation and artificial intelligence (AI) tools<\/strong>. Again, many frameworks for<br \/> collecting and processing large data sets are open source. But advanced<br \/> tools for making sense of data, like AI algorithms, tend to be<br \/> proprietary. The companies that develop these tools invest huge amounts of<br \/> money in them and rarely make them available to third parties.<\/li>\n<li><strong>Poor<br \/> incentives for data and AI sharing<\/strong>. Part of the reason for the challenge described in the preceding<br \/> point is that few organizations have strong incentives to share their data<br \/> and proprietary AI tools. To date, most companies that benefit from data<br \/> monetize it through advertising or internal research; there has been<br \/> little reward for them in sharing their data and data tools with third<br \/> parties.<\/li>\n<\/ul>\n<p>What all of the above means is that data has tended, so far, to be very undemocratic. It increases the power of organizations that are powerful to begin with and therefore have the resources to undertake large-scale, proprietary data collection and analysis programs. It leaves everyone else struggling to make sense of the tidbits of data that are available from open data sets, which are usually of limited value for gaining real-time insights. And even if you find access to meaningful, relevant data, you may not have the advanced AI tools that are necessary to turn the data into value.<\/p>\n<p>This is why we struggle to maximize the value of all of the data that is being generated around us. As Microsoft\u2019s Lucas Joppa <a href=\"https:\/\/www.nature.com\/articles\/d41586-017-08675-7\" target=\"_blank\" rel=\"noopener\">noted<\/a> in <em>Nature<\/em>:<\/p>\n<p>\u201cToday, we know more than ever about human activity. More than one-quarter of the 7.6 billion people on Earth post detailed information about their lives on Facebook at least once a month. Nearly one-fifth do so daily. &#8230; Yet we are flying blind when it comes to understanding the natural world.\u201d&nbsp;<\/p>\n<p>Joppa continued by pointing to some of the reasons why we do such a poor job of transforming all of the environmental data surrounding us into insight. The problem is not only that scientists \u201cdon\u2019t have the kinds of data needed to make such predictions\u201d but also that they \u201clack the algorithms to convert data into useful information.\u201d&nbsp;<\/p>\n<p>When all but a handful of organizations have the power to glean meaningful insight from environmental data, and they are not actually doing it, people who interact in critical ways with the environment \u2014 like foresters and builders \u2014 cannot make data-driven decisions that are in the best interests of all stakeholders. Nor can anyone hold them to account.<\/p>\n<p><strong>What It Takes to Democratize Data<\/strong><\/p>\n<p>It doesn\u2019t have to be this way. Data can be democratized in ways that make it practical for any person or group to derive insights from the data surrounding us.<\/p>\n<p>Doing so requires:<\/p>\n<ul>\n<li><strong>The ability to store and share data in<br \/> an open, decentralized way<\/strong>. Shared data would not only make more data available to people who<br \/> need it but would also \u2014 and this is a really important part of data<br \/> democratization \u2014 allow us to place data from many different sources on<br \/> the same plane and in the same context, so that we maximize visibility and<br \/> insights.<\/li>\n<li><strong>An incentives system that rewards<br \/> people for sharing data with each other and makes it feasible to monetize<br \/> data in ways that are not purely self-serving<\/strong>.<\/li>\n<li><strong>Access to AI-powered data analysis<br \/> tools that anyone can use<\/strong>.<\/li>\n<li><strong>Open, affordable data harvesters that<br \/> anyone can deploy<\/strong>.<\/li>\n<\/ul>\n<p>These solutions are all part of the platform that <a href=\"https:\/\/fluxiot.com\/\" target=\"_blank\" rel=\"noopener\">Flux<\/a> is building. Flux is the antidote to the natural tendency of big data and AI to monopolize power, rather than democratize it. By leveraging blockchain technology for open, affordable data storage, Flux provides the advanced AI tools necessary to reward organizations for sharing and collecting data via open-sourced hardware sensors called MICOs. In summary, Flux is creating a new environmental standard for data collection, storage and intelligence.&nbsp;<\/p>\n<p>Learn more by downloading the <a href=\"https:\/\/drive.google.com\/file\/d\/1BufBo-ePN776O11N5itPBiNLnpu0arvk\/view\" target=\"_blank\" rel=\"noopener\">Flux white paper<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>To date, access to this kingmaking power is very unequal. It has been concentrated in the hands of a select few companies, most of which were already quite powerful to begin with. They alone possess the enormous resources required to collect quality data and turn it into value.&nbsp; Meanwhile, the rest of the world is [&hellip;]<\/p>\n","protected":false},"author":3464,"featured_media":21537,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[39],"tags":[],"class_list":["post-21536","post","type-post","status-publish","format-standard","has-post-thumbnail","category-press-releases"],"author_data":{"id":3464,"name":"Btc Studios","nicename":"btc-studios","avatar_url":"https:\/\/bitcoinmagazine.com\/wp-content\/uploads\/2024\/12\/system-diy-promo-image-96x96.png"},"featured_image_url":"https:\/\/bitcoinmagazine.com\/wp-content\/uploads\/2024\/11\/democratizing-data-bringing-data-harvesting-and-analytics-to-the-masses.jpg","_links":{"self":[{"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/posts\/21536","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/users\/3464"}],"replies":[{"embeddable":true,"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/comments?post=21536"}],"version-history":[{"count":0,"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/posts\/21536\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/media\/21537"}],"wp:attachment":[{"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/media?parent=21536"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/categories?post=21536"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bitcoinmagazine.com\/wp-json\/wp\/v2\/tags?post=21536"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}