News – DAPLAB – Data Analysis and Processing Lab http://daplab.ch Reduces the entry barrier for companies to find value out of their data and ultimately turn into a data-driven company Tue, 10 Oct 2017 20:24:41 +0000 en-US hourly 1 https://wordpress.org/?v=5.6.10 http://daplab.ch/wp-content/uploads/2017/06/cropped-daplab-favicon-1-32x32.png News – DAPLAB – Data Analysis and Processing Lab http://daplab.ch 32 32 Workshop Data Science 19-20 October 2017 http://daplab.ch/2017/10/10/workshop-data-science-19-20-october-2017/ Tue, 10 Oct 2017 20:24:41 +0000 http://daplab.ch/?p=310 Dear DAPLAB’ers, there are still some places available for the workshop on data science co-organized by eXascale Infolab (UNIFR) and iCoSys (HEIA-FR). When: afternoons of 19 and 20th of October 2017 Where: UNIFR / HEIA-FR What (in french): Ce workshop organisé par IT-Valley s’adresse à tout informaticien désirant découvrir l’univers du Big Data et de la […]

The post Workshop Data Science 19-20 October 2017 appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
Dear DAPLAB’ers, there are still some places available for the workshop on data science co-organized by eXascale Infolab (UNIFR) and iCoSys (HEIA-FR).

When: afternoons of 19 and 20th of October 2017

Where: UNIFR / HEIA-FR

What (in french): Ce workshop organisé par IT-Valley s’adresse à tout informaticien désirant découvrir l’univers du Big Data et de la Data Science. Au programme, deux journées jalonnées d’exercices pratiques autour des technologies Hadoop et des frameworks d’analyse distribués.  Une partie des exercices se feront sur l’infrastructure DAPLAB

Registration:  https://goo.gl/uQD99T

The post Workshop Data Science 19-20 October 2017 appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
DAPLAB updated to HDP 2.6.1 http://daplab.ch/2017/08/04/293/ Fri, 04 Aug 2017 14:40:32 +0000 http://daplab.ch/?p=293 Dear users and friends, Thanks to a great team effort, the DAPLAB stack has been updated to the latest version. We are now running HDP 2.6.1 ! The following technologies have also been upgraded in the process: HDP 2.6.1 Ambari 2.5.2 Spark 1.6.2 Spark2 2.1.1 Kafka 0.10.1 Cassandra 3.11 Flink 1.4 We hope you will […]

The post DAPLAB updated to HDP 2.6.1 appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
Dear users and friends,

Thanks to a great team effort, the DAPLAB stack has been updated to the latest version. We are now running HDP 2.6.1 !

The following technologies have also been upgraded in the process:

HDP 2.6.1
Ambari 2.5.2
Spark 1.6.2
Spark2 2.1.1
Kafka 0.10.1
Cassandra 3.11
Flink 1.4

We hope you will enjoy the new features that are now available,

happy coding !

The post DAPLAB updated to HDP 2.6.1 appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
Voldemort Knowledge Graph http://daplab.ch/2016/08/02/voldemort-knowledge-graph/ Tue, 02 Aug 2016 10:53:57 +0000 http://daplab.ch/?p=201 VoldemortKG is an exciting project which explores the extent to which entities represented in different ways repeat on the Web, how they are related, and how they complement (or link) to each other. It has released a paper as well as made available its first results on this website. DAPLAB has made available the resources needed to create the […]

The post Voldemort Knowledge Graph appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
VoldemortKG is an exciting project which explores the extent to which entities represented in different ways repeat on the Web, how they are related, and how they complement (or link) to each other. It has released a paper as well as made available its first results on this website.


DAPLAB has made available the resources needed to create the dataset as well as to perform some of the computations. A great thanks to our collaborators Benoit Perroud and Chistophe Bovigny for their work !

We hope this is just the beginning of fruitful collaborations with external researchers and companies and that our infrastructure will help more researchers in their ground-breaking works.


Taking advantage of the growing amount of structured data produced on the Web is critical for a number of tasks, from identifying tail entities to enriching existing knowledge bases with new properties as they emerge on the Web. While this information has been essentially exploited by commercial companies, it remains an under-explored ground for the research community where several fundamental research challenges arise.

VoldemortKG’s goal is to provide tools, knowledge and models to extract and match structured pieces of data with high confidence in addition to provenance data, which constitutes a playground for researchers interested in a number of tasks including entity disambiguation & linking, entity typing, ad-hoc object retrieval or provenance management.

The post Voldemort Knowledge Graph appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
Big Data For SME – Presentation of DAPLAB at the 49es Journées romandes des arts et métiers http://daplab.ch/2016/07/06/presentation-daplab-49es-journees-romandes-des-arts-et-metiers-champery-27-et-28-juin-2016/ Wed, 06 Jul 2016 10:11:54 +0000 http://daplab.ch/?p=188 We presented “Big Data for SME with DAPLAB” in Champery at the 49th “Journée Romandes des Arts et Métiers”. About 100 people were attending at this conference about “Numérisation – Chances et Défis pour les PMEs” in Champery (CH), 27th and 28th of June 2016. More information here. DAPLAB actually interested many people who contacted us […]

The post Big Data For SME – Presentation of DAPLAB at the 49es Journées romandes des arts et métiers appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
We presented “Big Data for SME with DAPLAB” in Champery at the 49th “Journée Romandes des Arts et Métiers”. About 100 people were attending at this conference about “Numérisation – Chances et Défis pour les PMEs” in Champery (CH), 27th and 28th of June 2016. More information here.

DAPLAB actually interested many people who contacted us after the presentation. DAPLAB is indeed offering a good opportunity for SMEs to enter the Big Data and Data Analytics arena.

Extract of what was said during the presentation and Q/A session (in French):

 … DAPLAB est un laboratoire ouvert à toutes les entreprises et chercheurs qui se posent la question du Big Data. Dans ce domaine, le ticket d’entrée est cher, il faut des machines et des experts. Les grands s’y mettent. Nous réduisons la barrière à l’entrée pour les PME. Nous les accompagnons dans l’exploration et la valorisation des données. Le Canton de Fribourg participe au financement …

Big Data For SME with DAPLAB - Jean Hennebert - presenter of DAPLAB at the Journée Romande des Arts et Métiers.
Big Data For SME with DAPLAB – Jean Hennebert – presenter of DAPLAB at the Journée Romande des Arts et Métiers.

The post Big Data For SME – Presentation of DAPLAB at the 49es Journées romandes des arts et métiers appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
HDP 2.4.2 on the DAPLAB http://daplab.ch/2016/07/01/hdp-2-4-2-daplab/ Fri, 01 Jul 2016 10:56:08 +0000 http://daplab.ch/?p=173 We are proud to announce that the DAPLAB upgraded to the latest HortonWorks release, HDP 2.4.2. The upgrade went perfectly well, thanks to the skills of our technical team. The official Apache versions of most HDP 2.4.2 components are unchanged from HDP 2.4.0.0, with the exception of Spark and Kafka. Spark is upgraded from 1.6.0 to […]

The post HDP 2.4.2 on the DAPLAB appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
We are proud to announce that the DAPLAB upgraded to the latest HortonWorks release, HDP 2.4.2. The upgrade went perfectly well, thanks to the skills of our technical team.


The official Apache versions of most HDP 2.4.2 components are unchanged from HDP 2.4.0.0, with the exception of Spark and Kafka. Spark is upgraded from 1.6.0 to 1.6.1; Kafka is upgraded from 0.9.0 to 0.9.0.1.

Spark 1.6.1
  • ODBC/JDBC support for SparkSQL
  • Support for Spark Streaming and Kafka in a Secure Cluster (Kerberos-enabled)
  • Oozie Token support for Spark jobs
 Kafka 0.9.0.1
  • Support for MirrorMaker with a secure cluster (Kerberos-enabled)

More info: Hortonworks HDP 2.4.2 release notes

 

The post HDP 2.4.2 on the DAPLAB appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
DAPLAB is featured on the Swiss TV http://daplab.ch/2016/03/11/daplab-is-featured-on-the-swiss-tv/ Fri, 11 Mar 2016 08:59:21 +0000 http://daplab.ch/?p=109 On Saturday 5th of March, DAPLAB and its partners were featured on the Swiss television news (in french). We were able to introduce our activities and illustrate them with partner case studies of Infoteam and Swisscom.

The post DAPLAB is featured on the Swiss TV appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
On Saturday 5th of March, DAPLAB and its partners were featured on the Swiss television news (in french). We were able to introduce our activities and illustrate them with partner case studies of Infoteam and Swisscom.

The post DAPLAB is featured on the Swiss TV appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
Google #HashCode Hub @EIA-FR http://daplab.ch/2016/02/01/google-hashcode-hub-eia-fr/ Mon, 01 Feb 2016 12:34:42 +0000 http://daplab.ch/?p=95 We’re pretty delighted to announce that EIA-FR has accepted to be an official Hub for the next Google #HashCode, Thursday Feb 11. Since Thursdays is our hacky day, let’s code something different (or not, we’ll see :)). When Thursday, February 11. Doors open at 6pm, and will close around midnight. What Google #HashCode Contest Where Room […]

The post Google #HashCode Hub @EIA-FR appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
We’re pretty delighted to announce that EIA-FR has accepted to be an official Hub for the next Google #HashCode, Thursday Feb 11. Since Thursdays is our hacky day, let’s code something different (or not, we’ll see :)).

When Thursday, February 11. Doors open at 6pm, and will close around midnight.
What Google #HashCode Contest
Where Room C00.11/15, Ecole des Ingénieurs et Architectes de Fribourg, Boulevard de Pérolles 80, Fribourg.
How Team self-organization. Mind registering before Feb 9, and specify EIA-FR hub in your registration! Power and network connection provided.

We’ll open the room C00.11/15 at Ecole des Ingénieurs et Architectes de Fribourg (EIA-FR) at 6pm to give time to warmup our laptops and environments. Signs will be put in place to make your way safely to the room. The official contest starts at 6:30 pm and last for 4 hours. Drinks will be available for participants.

Please reach out in Hipchat or @DAPLABCH for more details. Teams can be formed on Thursday, but you MUST register before Feb 9. Please mention you’ll participate through the “Ecoles des Ingénieurs de Fribourg”‘s hub, this will help our logistic!

0

The post Google #HashCode Hub @EIA-FR appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
DAPLAB Session #1: Zefix Notifier Project http://daplab.ch/2015/10/07/daplab-session-1-zefix-notifier-project/ Wed, 07 Oct 2015 10:50:02 +0000 http://daplab.ch/?p=76 As announced a few weeks back, we’ll change the layout of the weekly DAPLAB sessions and come up with broader subject, spanning on several weeks. The first session we’re proposing is called Zefix Notifier. In a nutshell, we’ll ingest data from the Central Business Names Index of Switzerland (Zentraler Firmenindex, or Zefix in short). We’ll also […]

The post DAPLAB Session #1: Zefix Notifier Project appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
As announced a few weeks back, we’ll change the layout of the weekly DAPLAB sessions and come up with broader subject, spanning on several weeks.

The first session we’re proposing is called Zefix Notifier. In a nutshell, we’ll ingest data from the Central Business Names Index of Switzerland (Zentraler Firmenindex, or Zefix in short). We’ll also let any user enter some keywords, which we’ll match with the new data ingested, and notify (via email or callbacks) when a match is found.

Zefix Notifier Architecture
Zefix Notifier high level Architecture

The following deck is explaining in more detail the project: Zefix Notifier Project

It’s not mandatory to come to every sessions of the project, you can come any time and start to work with us from where we are.

See you on Thursdays!

 

Update: The work of day 1 is detailed in the Github project.

The post DAPLAB Session #1: Zefix Notifier Project appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
Spark Hello World http://daplab.ch/2015/09/21/spark-hello-world/ Mon, 21 Sep 2015 12:54:03 +0000 http://daplab.ch/?p=62 A new tutorial is available on docs.daplab.ch. It will guide you through the basics of Apache Spark and its scala interpreter (spark-shell). Enjoy !

The post Spark Hello World appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
A new tutorial is available on docs.daplab.ch. It will guide you through the basics of Apache Spark and its scala interpreter (spark-shell). Enjoy !

The post Spark Hello World appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
Pig Hello World http://daplab.ch/2015/09/21/pig-hello-world/ Mon, 21 Sep 2015 12:51:17 +0000 http://daplab.ch/?p=60 A new tutorial is available on docs.daplab.ch. It will guide you through the basics of Apache Pig. Enjoy !

The post Pig Hello World appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>
A new tutorial is available on docs.daplab.ch. It will guide you through the basics of Apache Pig. Enjoy !

The post Pig Hello World appeared first on DAPLAB - Data Analysis and Processing Lab.

]]>