# Open Source; Innovation in the Financial Sector
Author:  Pal Sinha, Barnali 
Author URL: https://financedigest.com/author/pal-sinha-barnali
Published: 2017-10-12
Category: TECHNOLOGY
Category URL: https://financedigest.com/category/technology
Meta Title: Unlocking Efficiency: Open Source Technology in the
Meta Description: Explore the impact of open source technology on the financial industry. Learn how it reduces costs, improves quality, and drives innovation in this insightful
URL: https://financedigest.com/open-source-innovation-in-the-financial-sectorhtml

![undefined](https://prod.superblogcdn.com/site_cuid_cm5qst7v3003gwirgwqtxn8i8/images/fd121017-13-1736843381073-compressed.jpg)

By **Michael Down**; Senior Solutions Architect, Elastic

The financial industry’s love affair with open source technology now runs far deeper than any simple attempts to reduce software licensing costs.

The free starting point offered by open source licenses can never be overlooked in driving initial technology adoption. For financial institutions whose [competitive advantage](https://www.financedigest.com/turning-the-burden-of-compliance-into-competitive-advantage.html "Turning the burden of compliance into competitive advantage") is often built on codifying ideas via bespoke software development, this zero-cost point of entry, combined with an open, documented code base delivers a compelling argument for open source software adoption.

However, the industry’s ongoing thirst for open technology has less to do with purchase price and everything to do with reducing the management of hundreds of different, disparate systems running multiple parts of the company. Financial organisations of all types are characterised by thousands of point solutions, serving many legacy systems. Banks hire tens of thousands of offshore staff to manage each solution.

The real draw of open source in modern [finance is the ability to explore and innovate](https://www.financedigest.com/innovations-in-finance.html "Innovations in finance") with new technologies; to easily scale the solutions that deliver real competitive advantage; and to reduce the overall cost of managing vast IT infrastructures through the use of common, best-of-breed technologies.

**Increased Quality with Reduced Management Burden**

From early Java-infused engineering to today’s polyglot, containerised, data-driven landscape, the simple quality and technical strengths of open source have been a key factor in its adoption. In an industry which attracts the world’s best graduates based on their higher-level maths, computer science and engineering skills, open source tools offer the fastest, highest quality way to turn ideas into secure, operational systems. Consequently, open source adoption has often been driven by the developers themselves.

From open languages like Java, Node.js and Python; through common tools and the familiar methods used in GitHub, Puppet, Chef, Apache Maven and Jenkins; to common architectures built on Linux, virtualisation, or Docker and Kubernetes: these commonalities dramatically reduce the cost and complexity of hiring, training and transferring staff between projects. For companies running thousands of applications simultaneously, this factor alone will outweigh licensing costs by an order of magnitude.

The crucial thing for all financial companies is to reduce total cost of ownership. This is about being able to reuse one technology or platform across multiple use cases in different areas of the business. As discussed later in this piece, the reason why open source search is so prolific within [Goldman Sachs](https://www.financedigest.com/telefonica-hires-goldman-sachs-to-sell-uk-mobile-masts-stake-el-confidencial-says.html "Telefonica hires Goldman Sachs to sell UK mobile masts stake, El Confidencial says"), is that teams can use and reuse the same platform across a number of different projects. One tool set – one support team – one knowledge base; but varied projects.

Goldman Sachs knows that by being sagacious in its choice of technology, teams can use it across a gamut of problems, in a host of business areas, without needing to go [back to the technical drawing board](https://www.financedigest.com/two-thirds-of-iaea-board-backs-western-statement-pressuring-iran.html "Two-thirds of IAEA board backs Western statement pressuring Iran") each time.

Goldman Sachs, and a host of others, are finding that working across problems on one open platform, they need far fewer people, focused on managing one underlying technology; rather than 40,000 offshore employees running individual toolsets.

**One Platform, Multiple Uses: Goldman Sachs**

Goldman Sachs provides a great illustration of a financial institution using one platform to solve multiple business issues. Having implemented a popular open source platform, they show how versatile search can be as a broad operational tool, incorporated into many different applications.

[Elasticsearch](https://www.elastic.co/products/elasticsearch) is deployed across a number of divisions and a variety of use cases – trade tracking, anomaly and error detection, and the analysis of contract applications, to name a few. In the latter case manual analysis of paper documents would require multiple legal teams do the heavy analytical lifting. Apache Tika was used by Goldman Sachs to digitise and index contracts. Elasticsearch is then used to review each document, alerting company lawyers if the right references or terminology are not found.

Trade tracking is also crucial, giving teams a live view of the [status on a trade](https://www.financedigest.com/u-s-congress-votes-to-strip-russia-of-most-favored-trade-status-ban-its-oil.html "U.S. Congress votes to strip Russia of ‘most favored’ trade status, ban its oil") at any given time, and also helping to eliminate both human and coding errors. Goldman’s trade tracker, gathers data from a number of sources, integrates and unifies it in Elasticsearch and then extracts useful data automatically. This reduces the need for large teams to extract the data manually.

‘Fat finger’ trading errors cost the industry billions every year, and there are plenty of high profile examples. In 2015 one of [Deutsche Bank’s](https://www.financedigest.com/citigroup-to-buy-deutsche-bank-license-in-mexico-for-wholesale-unit.html "Citigroup to buy Deutsche Bank license in Mexico for wholesale unit") hedge fund clients received $6 billion in error. Anomaly detection, therefore, is a priority for Goldman Sachs. And giving its community of developers access to a search-based data [management system has been key](https://www.financedigest.com/energy-management-system-market-2021-by-global-key-players-types-applications-countries-industry-size-and-forecast-to-2025.html "Energy Management System Market 2021 by Global Key Players, Types, Applications, Countries, Industry Size and Forecast to 2025") to more timely elimination of human error. On the bug detection side, around 700 developers now utilise Elasticsearch to trawl large code libraries to find all instances of coding anomalies. Goldman Sachs’ [developers use Kibana to build status](https://www.financedigest.com/turbo-compounding-systems-market-development-status-competition-analysis-type-and-application-2026.html "Turbo Compounding Systems Market Development Status, Competition Analysis, Type and Application 2026") dashboards which alert teams to code alterations, compares code version variations and pulls together disparate data sources in a simple interface.

**Dion Global:** [Wealth Management](https://www.financedigest.com/annual-survey-of-wealth-managers-2022.html "Annual Survey of Wealth Managers 2022")

Dion Global designs, develops and supports integrated [software solutions](https://www.financedigest.com/healthcare-software-solutions-to-ride-the-immunohematology-market.html "Healthcare Software Solutions to ride the Immunohematology Market") for financial institutions across the globe. The company has recently won [several awards](http://www.dionglobal.com/press-releases/dion-wins-best-innovation-award-at-the-systems-in-the-city-awards-2017) for its data analytics solution, built on open source search technology.

[Financial services firms have always worked](https://www.financedigest.com/turning-a-blind-eye-wont-work-for-financial-firms-as-the-fca-tightens-its-grip.html "TURNING A BLIND EYE WON’T WORK FOR FINANCIAL FIRMS AS THE FCA TIGHTENS ITS GRIP") to derive new insights from their data in order to improve decision making. What has changed, is how the effective use of data is increasingly becoming a core source of [competitive advantage that separates the leaders](https://www.financedigest.com/how-automation-gives-fs-leaders-a-competitive-advantage.html "How automation gives FS leaders a competitive advantage") from the laggards. Firms are increasingly looking to leverage business [data to drive](https://www.financedigest.com/how-alternative-data-drives-e-commerce-success.html "How Alternative Data Drives E-commerce Success") efficiency, grow revenues and improve margins. Dion Global’s Invantage Analytics module, built on the open source Elastic Stack, creates, [maintains and secures](https://www.financedigest.com/maintaining-security-and-compliance-amid-digital-transformation-in-financial-services.html "Maintaining Security and Compliance amid Digital Transformation in Financial Services") large volumes of data. The module delivers financial analysis using Logstash to ingest data, Elasticsearch for indexing, and Kibana to visualise results. In production, Dion has then licensed Elastic’s additional X-Pack features to [deliver additional security](https://www.financedigest.com/managing-compliance-complexity-will-deliver-security-rewards.html "Managing compliance complexity will deliver security rewards") for the highly sensitive data and to allow teams to access inherent machine learning capabilities.

The [analytics module helps financial companies derive insight from data](https://www.financedigest.com/big-data-analytics-fraud-prevention-in-the-financial-sector.html "BIG DATA, ANALYTICS & FRAUD PREVENTION IN THE FINANCIAL SECTOR"), which can be drawn from any number of external data feeds. It helps firms to influence the way they interact with customers, competitors, regulators, the market; even shareholders. Taking high level stock trade information, gathered at various stages of the trading process, data is aggregated to provide Dion [Global’s clients with an evaluation of their own customers’ stock trades](https://www.financedigest.com/global-stocks-trade-higher-at-the-end-of-a-volatile-month.html "Global stocks trade higher at the end of a volatile month"). Dion’s clients can then see all daily trades and retrospective trades made over the past 5 years.

Elastic alerting shows teams when a certain trade crosses a certain threshold – spotting anomalies faster. Later, anomaly detection will be handled by the machine learning capabilities inherent in X-Pack; reducing the need for manual queries which further helps Dion Global to model their data automatically.

**Swiss Life: 360 Degree Customer Visibility**

Swiss [Life is a major player in insurance](https://www.financedigest.com/what-type-of-life-insurance-policy-is-right-for-me.html "What Type of Life Insurance Policy Is Right For Me?") and wealth management. A few years ago, Swiss Life France embarked on a company-wide strategic [project](https://www.financedigest.com/digitally-projected-revenue-to-be-the-unique-selling-point-of-surgical-chisels-market.html "Digitally projected revenue to be the unique selling point of Surgical Chisels Market") – Digital Foundation – to re-architect and digitize its system architecture across all of its web and mobile-enabled portals and applications. With over ten million customer records accessed with divergent means and formats, it was becoming increasingly difficult to make data consistently accessible to different audiences including private and business clients, sales people, insurance brokers, and customer service representatives.

To streamline operations and unify access to information, Swiss Life France knew it needed a way to query customer records, at scale and speed, in real time. Initially, the company started working with Elasticsearch to index and publish its customer data. Mapping the system to the current and [future requirements of digitalization](https://www.financedigest.com/back-in-barcelona-telecoms-bosses-stake-claim-to-digital-future.html "Back in Barcelona, telecoms bosses stake claim to digital future"). The company had access to real-time queries across customer records, contract data, [market segmentation](https://www.financedigest.com/chondroitin-market-overview-analysis-by-top-players-product-segments-market-size-and-leading-key-players-2022-2029.html "Chondroitin Market Overview & Analysis by Top Players, Product Segments, Market Size and Leading Key Players 2022- 2029") data, and pension and insurance scoring information.

Using Elasticsearch, Swiss Life could merge multiple heterogeneous data sets together and derive cross-source insights continuously and in real-time. Elasticsearch gathers all the customer data in one place and acts as the single point of exposure for all customers through the MySwissLife customer website and mobile application. For the portal’s users, it is critical that the system is able to look up customer and contract information in milliseconds. Equally, Swiss Life must guarantee that the information is propagated to the index in less than 10 seconds after any record has been updated in the source systems.

**Innovating within New Regulatory Frameworks**

Regulatory complexity has slowed the [pace of innovation within banks in recent](https://www.financedigest.com/leno-bags-market-witness-a-spike-in-growth-pace-recent-improvements-in-pricing-models-fmi.html "Leno Bags Market Witness a Spike in Growth Pace Recent Improvements in Pricing Models: FMI") years. At the heart of this has been an inability to give teams a common platform to innovate and consume software toolsets at will. Competition now comes from technology companies, like Google, Facebook, Amazon and Apple, built around an ethos of ‘democratisation’; who provide ready access to tools [across the organisation to promote innovation](https://www.financedigest.com/open-finance-can-help-unlock-innovation-across-the-financial-ecosystem.html "Open Finance can help unlock innovation across the financial ecosystem").

For finance companies, a large part of the attraction of [open source technologies](https://www.financedigest.com/how-open-source-technology-is-securing-the-future-of-financial-services.html "How open-source technology is securing the future of financial services") comes from their low cost, low risk starting point. It costs nothing to download and start playing with open technologies, companies have nothing to lose in making toolsets widely available within development and engineering teams. Open source platforms tend to work the same across problems – same interface, same tooling, no complex integration – so it’s easy to experiment. A new way open source [technologies are enabling innovation](https://www.financedigest.com/research-and-technological-innovations-to-bolster-developments-in-polycarbonate-resins-market.html "Research and Technological Innovations to Bolster Developments in Polycarbonate Resins Market") is around new regulatory frameworks – particularly the Payment Services Directive 2 (PSD2).

**PSD2 and Erste Group Bank: Transparency for Consumers**

Giving consumers access to the full gamut of personal data held by their banks has become a priority as PSD2 comes into focus. Under this legislation, financial institutions must give [open](https://www.financedigest.com/the-future-of-open-finance.html "The Future of Open Finance") access to their payments infrastructure and customer data. This is to allow the industry to create transparent payments and [information systems](https://www.financedigest.com/the-cardiovascular-information-systems-market-is-expected-to-grow-on-a-persistent-note-in-the-future.html "The Cardiovascular Information Systems Market is expected to grow on a persistent note in the future") for consumption by the end-customer. EU member states must implement the legislation by 13th January 2018, with firms expected to show compliance soon after.

Erste Group Bank in Austria is [innovating on top of open source technologies](https://www.financedigest.com/research-and-technological-innovations-to-bolster-developments-in-animal-model-market.html "Research and Technological Innovations to Bolster Developments in Animal Model Market"), to provide transparent data access to consumers. George is the new [digital](https://www.financedigest.com/being-the-best-digital-bank-is-not-enough.html "Being the Best Digital Bank is Not Enough") banking arm of Erste Group Bank (EGB). George aggregates all elements of a customer’s financial life, to provide meaningful insight. It can analyse and visualise the way expenditure is split into different elements and align this to a user’s [current account](https://www.financedigest.com/coffee-current-accounts-and-the-commoditisation-conundrum.html "Coffee, current accounts and the commoditisation conundrum"). It can also estimate expenditure based on previous history and help users adjust spending if they can see they’re over-spending in some areas.

Launched in Austria in 2015, George now has more than a million users. With George, EGB is taking the step from classic online banking to a digital banking platform; in alignment with PSD2. For many of the new applications and George’s modern user interface, an Elasticsearch cluster is responsible in the background. In addition to the semantic search, this also includes statistics based on Elasticsearch Aggregations.

Erste has also used Elasticsearch to define an API on which the clients (e.g. web front end, mobile clients, specialized clients) are based. This [allows the company to present a uniform appearance to customers across all groups and to quickly integrate the developments and innovations](https://www.financedigest.com/esg-innovation-allowing-everyone-to-meet-the-standard.html "ESG innovation: Allowing everyone to meet the standard") of the local banks into the entire group.

**Conclusion**

Open source software in the [finance industry](https://www.financedigest.com/how-to-drive-a-data-culture-in-the-finance-industry.html "How to drive a data culture in the finance industry") is now about building on best-in-class open technologies, which have thriving, active communities around them. For institutions with thousands of [applications to manage](https://www.financedigest.com/service-lifecycle-management-applications-market-to-grow-at-a-cagr-of-6-9.html "Service Lifecycle Management Applications Market to grow at a CAGR of 6.9%"), it is about the ability to transfer and reuse common technologies, developers, procedures, operations and even power-users, across multiple projects. The ability to source talent, and to pull in experience and innovation from other industries that are using the same technologies, adds to this draw.

What is changing is that where this once applied to open development languages, operating systems, toolsets and architectures, this thirst for powerful, reusable technologies is increasingly moving up the stack. Burned by the cost of grandiose one-off big data projects, many companies have now learned to leverage complete open source applications capable of solving a multitude of problems across the business.


---
This blog is powered by Superblog. Visit https://superblog.ai to know more.
---