Documente Academic
Documente Profesional
Documente Cultură
Special Report
trading technologies for financial-market professionals
Sponsored by:
waterstechnology.com
June 2012
thomsonreuters.com
READY TO
OUTPERFORM?
HOW MUCH DO YOU EXPECT FROM
MACHINE-READABLE NEWS?
EXPECT MORE. WHETHER YOU ARE
RUNNING BLACK BOX STRATEGIES
THAT NEED SUB-MILLISECOND DATA OR
MANAGING MEDIUM-TO-LONG-TERM
INVESTMENTS, THOMSON REUTERS
NEWS ANALYTICS ENABLES YOU TO
OUTPERFORM THE COMPETITION.
Be the first to react to market-moving economic or company events.
Analyze thousands of news stories in real time to exploit market
inefficiencies or manage event risk. Use statistical output from our
leading-edge news analytics to power quant trading strategies across
all frequencies and provide additional support to your decision makers.
With unmatched depth, breadth and speed of news, razor-sharp news
analytics and both hosted and on-site deployment options, we have
everything you need to gain critical insight. And turn that insight into profit.
THOMSON REUTERS NEWS ANALYTICS. DISCOVER. DIFFERENTIATE. DEPLOY.
KNOWLEDGE TO ACT
Victor Anderson
Editor-in-Chief
Sell Side
News
Sponsors Statement
Unlocking the
Value in Big Data
With growing volumes, velocity and variety of data, it is no
longer enough for nancial services rms to limit their analysis
to traditional market data. To unlock the real benets of
Big Data, one needs to analyze broader sources, such as
unstructured data, and combine that information with existing
signals to differentiate and enhance trading, investment, and
risk models. By Richard Brown
Richard Brown
BIG
Challenges
How do you define Big Data? Is this a new phenomenon, or simply the next phase of enterprise data
management with a catchy new name?
Louis Lovas, director of solutions, OneMarketData: Big
Data can be defined by two salient points. First there is supporting hardware. Bigger, faster, parallel hardware architectures
have not only enabled greater compute power but also massive
growth in storage capacities. This classic Moores Law model has
created maximal efficiencies in storage per dollar. Yet hardware
has long been subject to commoditization. Practically speaking,
Roundtable
Peter Chirlian
Chief Executive Ofcer
Armanta, Inc.
Tell: +1 973 326 9600
Web: www.armanta.com
bigdata@armanta.com
Peter Chirlian, CEO, Armanta Inc: With competition, new regulations and shortened product lifecycles, managers are forced to run
a data-driven business instead of simply relying on instinct. Big Data
represents the convergence of trends in software and hardware, along
with billions in venture capital, which has led to the emergence of
new platforms for data management and analysis. Its given businesses
the ability to deploy many platforms, each suitable for a class of business questions. Big Data offers the promise of finally enabling a truly
data- and analytics-driven enterprise. In such an enterprise, analytics
isnt just a point solution. It is an end-to-end process involving
everything from data gathering and cleansing to operationalizing
business processesacross the entire spectrum of new Big Data tools
and existing data infrastructure.
Dennis Smith, managing director, BNY Mellon: Big Data is
data that has any of the following characteristics: extreme volume,
wide variety of data formats, high velocity of record creation, along
with variable latencies and the complexity of individual data types
within formats. Note that it is about more than just volume. There
is a bit of an evolution. Existing technologies have allowed us to
perform analysis of historical data. Big Data has the potential to not
only provide us better insight into the current situation, but also
positions us to be more predictive.
Andrew Poulter, head of risk analytics and methodology
technology, RBS: I think there is certainly a cultural shift in
terms of how people think about data, the importance of data
retention, and how this can be fed back to improve business
processes and ultimately margins. Technically, I see Big Data as an
evolution as opposed to a new phenomenon or revolution.
Marcus Kwan, vice president of product strategy and
design, CQG:Big Data is the issue surrounding the massive
increases in the number of data sources, volume of the data, the
speed, and granularity of the data compounded over history. It has
become more relevant in the past few years because of the number
of exchanges going electronic, data collection methods, and the
rate of technological advances. Big Data has become an issue for
financial services due to pressuresboth regulatory and competitiveand the need to identify opportunities for profit. Traders
used to make trading decisions plotting charts with pen and paper.
The technology and complexity is now light years from that time.
Marcus Kwan
Vice President, Product Strategy and Design
CQG
Tel: +1 720 904 2933
Email: marcus@cqg.com
Web: www.cqg.com, news.cqg.com
Roundtable
Ilya Gorelik
Founder and CEO
Deltix Inc.
Tel: +1 617 273 2540
Email: sales@deltixlab.com
Web: www.deltixlab.com
Poulter: I think financial services has always had the ability to generate far more data than was possible and realistic to storefor example,
price histories, transaction-level risk data, and so on. Big Data has
made it possible to store more of what is currently generated, to enable
more detailed drill down, trend analysis over time.
Louis Lovas
Director of Solutions
OneMarketData
Tel: +1 201 710 5977
Email: louis.lovas@onetick.com
Web: www.onetick.com
Kwan: The technology is evolving rapidly. While the days of proprietary formats are giving way to application programming interfaces
(APIs) and more flexible formats, many firms arent prepared to make
the switch. Legacy systems are so entrenched into processes, that even
the thought of replacement is too painful. The strategy, benefits and
return on investment has to be clear before commitment.
Consistency is very hard to fulfill in large datasets. Relaxmost filtering of data which often require multiple sets of complex analytical
problems can be solved with eventual consistency.
transformations. All these challenges dictate solutions involving a
Functional programming frameworks are better at solving most thousands of messages per second.
parallel distributed problems.
10
Roundtable
development and storage/data management, there are three technologies associated with each: MapReduce, Pig, and Mahout with
modeling/development; and Hadoop Distributed File System, HBase,
and Cassandra with storage/data management.
Richard Brown
11
What do most firms tend to overlook when embarking on Big Data projects?
Gorelik: We find that the focus on storing data sometimes
results in insufficient emphasis being placed on the use of data.
Regulatory requirements aside, storing data is only useful if subsequent analysis yields information that is valuable. Such analysis
is computationally and mathematically complex and demanding.
Having tools to define and test trading ideas quickly, and then
refine ideas, is a major competitive advantage in a trading firm.
By focusing on the logistical headaches of collecting data, an
emphasis on analytical tools is often overlooked.
12
Lovas: Big Data ultimately defines the end game, that Holy Grail for
profitability. Firms should not lose sight of that. The Big Data dump
and the solutions to manage and analyze it are the fuel that drives the
engine of the trade life cycle. That includes the profitability profile of
new models, optimizing existing models, re-balancing portfolios and
managing the fluid nature of transaction costs. They all depend on Big
Data solutions to provide accurate, clean data across a firms tradable
markets. Firms need a clear understanding that Big Data is pervasive
across the engine of the trading business to ensure success.
Kwan: Strategy, Strategy, Strategy. Have you really figured out
how to make trading decisions off social media and tweets? Maybe.
Historically, successful firms have been able to find patterns in the
market. I believe the game is the same, but the data set is much more
complex. Firms have to be able to adapt to new methods of pattern
finding. A big part of that is infrastructure, of which a very important
piece is a new class of advanced visualization tools.
Brown: We see a number of areas that are not fully appreciated
when embarking on Big Data projects, particularly in the analysis
of unstructured data. Often times, we see clients attempt to analyze
text believing they can have control over the secret sauce. While
the motivations are understandable, it is a very difficult proposition
on which to successfully execute and one can conjure up the phrase,
kids, dont try this at home. Challenges range from the difficulty of
a portfolio manager to vet a qualified linguistic analyst team, to not
knowing what you have/dont have, until its failed/finished.
We see a lot of false starts and abandoned projects in this space and
in some cases it is due to unsuccessful language processing, and in
others, the firms have trouble getting those techniques into production with the necessary fault-tolerant, fully resilient infrastructures to
handle such information in the speed needed for financial markets.
We believe the right system should be flexible enough to enable users
to do what they want, but robust enough for them to simply want
to focus on the higher value-added activities like interpreting the
analytics for their investment or trading strategies. When it comes to
unstructured/text analysis, Thomson Reuters News Analytics offers a
great mix at both ends of the spectrum and everywhere in between.
Smith: I mentioned a few of these before: skills, data management,
and so forth. Looking at the data management layer, Big Data might
cause the thinking to go from a physical orientation to a logical orientation, where things are relative for just a period of time. Additionally,
it might change thinking in the data quality area, from things needing
to be 100 percent accurate to being directionally correct. This also
highlights the complementary nature of the technology where it could
front-end traditional tools.
Chirlian: Big Data is revolutionizing the way business is conducted. It
isnt enough that enterprises invest in new technologies for managing
and analyzing data. They must now be able to arm their business users
with easy, anytime access to the data they want and enable them to
analyze this data interactively. The analytics-driven businesses of the
future are those that understand this end-to-end analytic process and
put in place a well-integrated technology solution empowering the
businesses to be confident in their decisions.
WatersTechnology delivers:
waterstechnology.com
waterstechnology.com
June 2012