In this blog, we are going to take a look at Apache Spark performance and tuning. This a common discussion among almost everyone that uses Apache Spark, even outside of Talend. When developing and running your first Spark jobs there are always the following questions that come to mind.
Formed in 2016, Paddy Power Betfair (PPB) is the world’s largest publicly quoted sports betting and gaming company, bringing “excitement to life” for five million customers worldwide. The merger of Paddy Power and Betfair in 2016 created an additional data challenge for an already highly data-driven organization. The merged company had to bring together 70TB of data, from dozens of sources, into an integrated platform.
Recently I found myself in a predicament that many of you can relate to, trying to update an aging application that has become too difficult to manage and too costly to continue operating. As we started to talk about what to do, we concluded it was time to start decomposing that application into smaller more manageable pieces.
Companies don’t gain business value just by gathering lots of data. They don’t even necessarily gain value from analyzing the data. The true keys to success are choosing the right data to focus on, knowing what to do with it, and determining the best ways to apply analytics to solve business problems or address market opportunities.
Artificial Intelligence (AI) emerged as a hot topic in 2017. Although scientists have been working on the technology and heralding its numerous anticipated benefits for more than four decades, it’s only in the past few years that society’s AI dreams have come to fruition.
Where is AI going and how we can work with it in the future of BI?
Today, we announced our new membership in the OpenAPI Initiative, an open source collaborative governance organization led by the Linux Foundation, which focuses on standardizing how web APIs are defined and utilized to drive industry adoption, interoperability and best practices.
Open source software (OSS) just celebrated its 20th anniversary and not only does the community have a lot of milestones to celebrate, but also a lot to which they can look forward! OSS continues to disrupt the status quo in groundbreaking ways, but it’s also becoming increasingly mainstream. Thus, if you’re an IT leader of any-sized organization, you should be thinking about and planning for how to incorporate OSS into your infrastructure.
I hope you have had a chance to read my earlier blog about the steps that an organization can take to become data-driven. The more I thought about that particular blog, the more I realized that it does make a very significant presumption: that companies should become data-driven. Which begs the question - why would a company want to become data-driven?
