How do you connect young students from the developed world with people living in a small village in Kenya? How can you fight to preserve local Italian seed varieties that are becoming extinct, even if you are at the other side of the planet? How can you link a grand challenge (like feeding the increasing population of the planet) to a very local one (like helping a rural area to become more attractive to young families)? In the context of the CAPSELLA project, we are trying to make these exact connections and put the collective brain power of people interested in solving the pressing problems that matter.… Click to read the full post
How do European officials working on agriculture and food topics deal with the emerging data revolution in the sector? How can they be aware of the recent developments in a way that may inform their thinking? And how can they respond to the community needs by appropriately shaping the policy programs and support instruments?
This was the topic of a meeting that took place in Brussels on September 30th, 2016. The meeting was organised by the Big Data Europe project, in collaboration with the Global Open Data for Agriculture and Nutrition (GODAN) initiative. The Food and Agriculture Organization (FAO) of the United Nations and Agroknow, being the Big Data Europe partners responsible for the food and agriculture sector, worked together with the Institut National de la Recherche Agronomique (INRA) in order to invite to the meeting representatives from the European Commission (EC) DGs and a select group of community stakeholders.… Click to read the full post
One of the fun things we did during our visit to Ontario this September was our meeting with Canada’s first NSERC Industrial Research Chair for Colleges: Dr. Mike Duncan. With a specialization in Precision Agriculture and Environmental Technologies, the five-year mission of Mike as a NSERC Chair was to develop data-powered solutions for provincial and national farming communities.
Mike, Gregor MacLean and the Agriculture & Environment Innovation Center team at the Niagara College are focused on developing new ways to gather, process and disseminate the massive amounts of data gathered each day from Ontario farms, including the use of an experimental unmanned aerial vehicle (UAV) and field sensors.… Click to read the full post
The National Institute of Food and Agriculture (NIFA), a federal agency within the United States Department of Agriculture (USDA), is convening a summit to identify the frontiers and future of data in agriculture and build on existing U.S. government wide-efforts and investments in Big Data. Save the date for an opportunity to help shape the agenda driving innovation in the agricultural enterprise. You can join the event via livestream as leaders in agriculture and data science fields converge to synthesize the future of data-driven agriculture.
This October 10, 2016 event entitled “Data Summit: Changing the Face, Place, and Space of Agriculture” will include an address from NIFA Director Dr.… Click to read the full post
Let’s take a step to the near future.
A shared global data space for agriculture and food will propel the industry forward. Information will become available to all actors producing innovation. Analytical and decision making tools can incorporate a greater abundance of data sources. A digital economy may arise with online services and applications that use machine readable, interoperable and often publicly shared data. The necessary infrastructure components, including the technology, people, policy and business ones, may seamlessly integrate and work together.
We believe that Europe is strategically positioned to lead such a transformation of the agriculture and food industry.… Click to read the full post
European project makes big data technologies easy to use.
Across society, from health to agriculture and transport, from energy to climate change and security, practitioners in every discipline recognize the potential of the enormous amounts of data being created every day. The challenge is to capture, manage and process that information to derive meaningful results and make a difference to people’s lives. The Big Data Europe project has just released the first public version of its open source platform designed to do just that. In 7 pilot studies, it is helping to solve societal challenges by putting cutting edge technology in the hands of experts in fields other than IT.… Click to read the full post
As promised and planned, on Thursday 19th of May, second day of the meeting and after the end of all discussions and presentations, it was time to offer all participants a first sneak preview of the use case pilot demonstrator that we have been developing in the context of the BigDataEurope Horizon 2020 project.
In order to help participants visualize what this demonstrator will be all about and what problems could help solve, we had organized a hands-on-visit to a nearby traditional vineyard and winery.… Click to read the full post
The time has come again to open our home to the world. To invite good colleagues and friends, but to also welcome new people that we are meeting for the first time. To organise and host a special event, a unique gathering, a meeting of some select great minds, in order to discuss openness and information. Our Open Harvest series of events is kicking off this May in Chania, Crete. It aims to become a very special meeting and collaboration opportunity for people that work on various aspects of open sharing and discovery of information related to agriculture, food and the environment.… Click to read the full post
In an earlier post, we explained how Variety, one of the four Vs of Big Data, applies in a specific domain as is the one of Viticulture and how all this connects with Agroknow’s work (a.k.a. our use case pilot) in the context of the BigDataEurope Horizon 2020 project.
Viticulture is one of those domains of Agriculture, and obviously not the only one, where data are present throughout the entire process, from the vineyard where various activities take place to the laboratory where analyses are being done. Different vineyards to set the experiment, different grapevine varieties or even different samples of the same variety but from different locations to study, different equipment to use, different methods and protocols to follow, all these contain more than one type of data and all these constitute variables that can differentiate the research outcomes.… Click to read the full post
In a previous post, we addressed Hadoop ecosystem and a set of tools that reside and operate near the two core components of Hadoop (i.e. MapReduce and HDFS) to help them store and manage data, and perform various analytic tasks. However, Big Data landscape is more than Hadoop alone.
In this post, we will expand the circle a little bit and address the many technologies that are involved in Big Data processes. The Big Data landscape can be daunting. The vast proliferation of technologies in this competitive market means there’s no single go-to solution. However, it is possible to group the different tools and frameworks based on similarity in goal and functionality into a number of main components:
- Distributed file systems: file systems that run on multiple servers and allow access to files from multiple hosts, which means the ability to share files and storage resources by multiple users.