Industry: Internet and Telecommunications

JetBrains products used: Datalore

Organization Size: 3000+

Country: Japan

LINE Corporation

Line Corporation provides services in various areas such as media, commerce, and fintech, based on the communication application “LINE” which has 193 million MAUs (monthly active users) globally and 94 million MAUs in Japan.

“During the evaluation process, we found that Datalore’s UX was familiar to our developers, and the report-sharing functionality was easy to use. Thanks to the collaboration of our engineering team and the Datalore development team, we managed to satisfy our workflow and data governance requirements.”

— Seongduk Cheon, a Senior Manager at LINE Corporation

How LINE adopted Datalore as a new data analysis platform

About LINE

Could you please introduce yourself?

My name is Seongduk Cheon. I am a Senior Manager at LINE Corporationleading an organization called the Data Platform Department. Our mission is to democratize the use of data and provide a platform for users within the company to analyze data.

What kind of projects is LINE involved in?

We provide services in various areas such as media, commerce, and fintech, based on the communication application “LINE” which has 193 million MAUs (monthly active users) globally and 94 million MAUs in Japan.

The Data Platform Department provides users with a platform for collecting, storing, managing, and analyzing data from LINE’s various services. Called IU or Information Universe, this is the company-wide data infrastructure that contains the data of various businesses.


Problems to solve

What made you look for Datalore or alternative solutions? What challenges did you face?

In recent years, the demand for data analysis within the company has increased. Requests for notebook solutions have grown well beyond simple query execution, especially from data scientists and machine learning engineers. OASIS, the in-house notebook solution we had been using, lacked the development resources to meet these diverse needs.

We began evaluating new notebook solutions, and Datalore was one of the candidates.

During the evaluation process, we found that Datalore’s UX was familiar to our developers, and the report-sharing functionality was easy to use.

Thanks to the collaboration of our engineering team and the Datalore development team, we managed to satisfy our workflow and data governance requirements:

  • Client mode support for Spark
  • Support for native R packages
  • Enhanced audit logging
  • Fine-grained permission management for reports and workspaces

These features were critical for us and we decided to choose Datalore as our data science platform.


“We are also pleased to see that Datalore is being used by many more users than we initially expected, including those in roles other than data engineering and data science. Ultimately, we expect Datalore to be used by several hundred users in LINE.”


The Datalore experience

Who uses Datalore in your team?

Although Datalore was deployed in LINE quite recently, nearly half of the data analysis teams within both the LINE Group and the Group companies are using Datalore as of March 1, 2023. We are also pleased to see that Datalore is being used by many more users than we initially expected, including those in roles other than data engineering and data science. Ultimately, we expect Datalore to be used by several hundred users in LINE.

Has the onboarding process changed after adopting Datalore?

First, the barriers to the introduction of Datalore were not high. While we received some questions from users at the beginning, the familiar UI/UX made it easy for those who had been using our in-house solutions, OASIS and Jupyter, to get started.

Second, the biggest challenge for our users was executing jobs in Spark’s client mode. Through the collaboration of our development and Datalore support teams, we managed to solve this issue.

Third, there was a gap between the Datalore product concept and LINE data governance in terms of authority management, which brought some difficulties. Thanks to collaborative discussions with the Datalore development team, we were able to clear this gap and officially adopt Datalore.

What kind of data do you work with? How do you share the results of your work?

Since we are a data infrastructure provider, we don’t know the details of the data. Those who have access to IU (Information Universe) import and analyze data through Datalore.

We usually share results of our work by publishing Datalore report links to organization wikis and we find the reporting features very useful.


“Since Datalore has just been deployed, we managed to free up internal development resources when we decided to switch from our in-house data science platform to Datalore. We also managed to satisfy our data governance requirements, which was critical for LINE compliance policies.”


How do you think LINE will benefit from using Datalore?

Since Datalore has just been deployed, we haven’t had a quantitative evaluation for the returned value yet. However, we managed to free up internal development resources when we decided to switch from our in-house data science platform to Datalore. We also managed to satisfy our data governance requirements, which was critical for LINE compliance policies.

We expect that the introduction of Datalore’s notebook solution will promote data-driven decisions by those who have a role in data analysis within the LINE Group. If the results of data analysis can be deployed smoothly and quickly in the various business divisions of LINE, it will contribute to the business by enabling faster PDCA cycles and more data-driven decision-making.

Contacts

Similar Customer Stories

Hunters

Netanel Golani, a Threat Hunting Expert at Hunters

It has only been a month since the data science team at Hunters started using Datalore, and we have already seen productivity and usability improvements in our daily workflow – especially when working with numerous customer data sources.

The Center for New Data

Chad Rosenberg, Head of Technology, The Center for New Data

Datalore just gives us ways to work on our data that we won’t get in Airflow, like debugging the pipeline results, trying the webhooks, and quickly visualizing the data with automatic plotting features. Being able to use the native Snowflake connector in Datalore, as well as the programmatic ones in pandas, has definitely been a time saver when working on shared notebooks.

TrueLayer

Moreno Raimondo Vendra, Senior Machine Learning engineer, TrueLayer

Datalore enabled our team to ergonomically access our data while meeting the security requirements, which was a game changer for us. As a result, we could collaborate much more easily both within our Machine Learning team and with our stakeholders.

More customer stories