• <div class="header-image" style="background-image: url(/live/image/gid/4/2611_Header_V6N2_web_4.rev.1518551584.jpg);">​</div><div class="header-background-color"/>

The Non-Trader’s Guide to High Frequency Trading

January 05, 2016
A great hullabaloo has been made about High Frequency Trading (“HFT”) and algorithmic trading (“algos”). The focus of articles in Bloomberg and the Wall Street Journal, not to mention the one book that started it all,[1];HFT has captured the market’s attention. High Frequency Trading has a dubious reputation (again, see Michael Lewis); it is oftentimes technically challenging and firms have an incentive to keep their trading strategy under wraps. If everyone knew Virtu Financials’ algos and trading strategy, Virtu would lose its competitive advantage.[2]

by Kathleen Zhou, W’17

Not much has been written for the Non-Trader, who does not work in a government financial regulatory agency[3] or in the Street or has taken classes where professors drop three-letter acronyms like they’re hot. Consider this the layman’s guide to High Frequency Trading, written by someone who has an interest, WiFi, spare time, and supervisors who’ve pointed me in some interesting directions.

We start with the basics

High Frequency Trading (“HFT”) is the use of complex algorithms to transact, track, and execute a large quantity of orders in a matter of milliseconds.[4]

Michael Kearns, a professor in Penn’s Computer and Information Sciences department, draws further distinction between so-called “passive” HFT and “aggressive” HFT. Passive HFT involves setting limits (e.g. “sell if below x price” and “buy if above y price”), exclusively waiting for the order to be fulfilled. Aggressive HFT involves actually crossing the bid ask spread (a fancy way of denoting a firm, instead of placing orders, is forced to transact at the market’s prices, buying at x or selling at y) and consequently paying the order’s execution costs.[5]

Why does speed matter?

When our friendly neighborhood trader in Philadelphia places an order to buy 200 shares of Amazon, bidding $524.00 a share, the computer then drops that trade in one of eighteen national securities exchanges, not to mention the thirty-odd alternate trading systems (“ATS” or “darkpool”). Our trader’s bid will join a line of bids, and will sit in line until the higher bids are fulfilled and a seller’s ask matches our trader’s bid. Being first could mean our trader gets a better deal. So that’s why HFT firms are eyeing NATO microwave towers; speed is king, and shaving a few more milliseconds could result in more profits.

What Happens When you Place a Trade on the Stock Exchange

But! It is obvious the time between an order being placed and an order landing in an exchange can never hit zero. And reducing time by fractions of milliseconds becomes more and more expensive as returns become smaller and smaller.[6] In this humble writer’s opinion, it’s akin to an asymptote at zero. So what will our trader do now?

Your Pretty Little Algorithm

What is perhaps more important than just sheer speed is (increasingly complex) algorithms. If our friendly neighborhood trader invests in high-tech algos, our trader can track trends and price movements before they happen and position orders accordingly. A sound algorithm is capable of using “reinforcement learning” to optimize revenue, predicting price movements from an order book or bids and asks, and “exploring” dark pools to determine the best execution.[7] For an HFT firm, an algorithm is essential. Say a seller of Amazon is currently asking $523.99 a share and a buyer is currently bidding $523.97 a share. Our clever HFT firm’s algorithm could examine these bids and decide Amazon should be selling at $524.02 a share, according to historical data and the current status of the order book, and so ‘cuts’ by bidding $523.98, putting the firm ahead of the original buyer. Once Amazon’s stock price rises to $524.02 a share, our clever HFT firm then turns around and sells its shares, pocketing a pretty four cents a share.[8] A speed advantage and predictive algorithm serves to help the firm gain an advantage.

In equities (a type of security “representing an ownership interest”[9]), algorithms account for 50 percent of trading volume. In other securities (such as treasuries, commodities, futures, etc.) algos make up a similar percentage of trading volume.

On Flash Boys

Seeing as this writer has referenced the above book twice in the opening paragraph, the writer feels obliged to give some background. Michael Lewis, former bond-salesman at Salomon Brothers[10] turned writer and Street critic, published Flash Boys to criticize HFT and alternate trading systems (“ATS”) as exploitive and unfair. The focus of Lewis’ argument is that HFT firms, in their ability to be first and predict price movements before they happen, have some sort of unfair advantage.[11] A choice selection from Flash Boys:

It used to be that when [Brad Katsuyama’s] trading screens showed 10,000 shares of Intel offered at $22 a share, it meant that he could buy 10,000 shares of Intel for $22 a share. … By the spring of 2007, however, when [Katsuyama] pushed the button to complete a trade, the offers would vanish. In his seven years as a trader, he had always been able to look at the screens on his desk and see the stock market. Now the market as it appeared on his screens was an illusion.

The book chronicles Katsuyama as he founds what became IEX, an ATS that adds 350 microseconds to each order to remove the advantage of speed and complex predictive algorithms that firms with HFT firms employ.

Arguments against Flash Boys

Virtu Financial doesn’t call itself a HFT firm. It calls itself a “leading electronic trading firm” and a “market maker.” Market makers supply the holy grail of traders: liquidity. It is both the technical definition outlined in Investopedia (“the degree to which an asset or security can be bought or sold in the market without affecting the asset’s price.”) and, in this humble writer’s opinion, a shorthand to denote risk (a liquid asset is easy to sell and easy to hedge your bets with) as well as the market’s health (a liquid market means lots of transactions and smooth sailing). a Market makers hold shares in a given security and guarantee buy and sell prices for a certain number of these shares in order to facilitate trading. The NASDAQ, one of the largest exchanges in the US, has more than 500 member firms which act as market makers.

HFT firms like Virtu Financial, in their ability to guarantee shares at certain prices and execute orders in mere milliseconds, allows traders to place and exit positions before even blinking. When major market shifts happen (such as the inevitable raise of interest rates or ITG announcing a huge SEC fine) traders can adjust their portfolios as needed.

Does HFT impact me?[12] 

Michael Kearns would be skeptical. In his paper “Empirical Limitations on High Frequency Trading Profitability,” he suggests profitability is limited to $3.4 billion (almost two thirds of which would be lost to trading fees) for the entire HFT firm population. In 2008, he determined profits were bounded up to $2.1 billion. For scale, the entire annual U.S. trading volume is worth $52 trillion, meaning at most aggressive HFT profits would constitute 0.05% of trading volume.[13] Kearns’ study examined only aggressive HFT firms (remember, the ones that are forced to execute trades at the market’s prices instead of setting limits) using data from 2008-2009.

But remember our clever HFT firm, the one that ‘cut’ in line by bidding a higher price on Amazon shares? The example I described is often cited as a legal form of front-running, in which our clever HFT firm has, in effect, jumped ahead of the queue by offering a more competitive price.[14]This can certainly make it harder for individual investors without the same level of sophistication to buy the shares of Amazon our clever HFT bought first, and practically impossible to compete on a micro-level, millisecond to millisecond scale.  Without the same technology—the high speed fibers, NATO microwave towers, lasers—an individual investor, or a small firm, must turn to other strategies and other approaches to make a profit.[15]

What does this mean for smaller agents, like unsophisticated investors and small firms? Will HFT firms essentially stop pushing for more speed advantages? What impact will HFT and algo trading firms have on the future? 

Both high frequency trading and algorithmic trading are both newer technologies. The full extent of their impact on both liquidity and the players in the financial markets remain to be seen. That newness, that potential for profound change (or not) is what makes them such a topic of discussion in The Wall Street Journal and in this post.

  [1] See Michael Lewis’ Flash Boys, published March 31, 2015.

  [2] In its April IPO filings, Virtu Financial claimed out of four years of trading (approximately 1,278 days) it incurred exactly one day of losses. (An interesting note: Virtu Financial also does not call itself an HFT firm, preferring to emphasize its technology roots.) Chief Executive Officer Doug Cifu later regretted trumpeting Virtu’s track record; this writer suspects trotting out a near-perfect trading record just as a book criticizing HFT firms for having an unfair advantage might have backfired. But hey! Any publicity is good publicity~

  [3] The U.S. Securities & Exchange Commission (“SEC”), the U.S. Commodities Futures Trading Commission (“CFTC”), and the Financial Industry Regulatory Authority (“FINRA”), to name a few of the agencies tasked with regulating the financial market. This humble writer interned in the Division of Trading & Markets at the SEC.

  [4] “High Frequency Trading.” Investopedia.com. Web. 9 Aug. 2015. http://www.investopedia.com/terms/h/high-frequency-trading.asp (Buckle down, it’s going to get a lot more complicated than this)

  [5] Michael Kearns, Alex Kulesza, and Yuriy Nevmyvaka. “Empirical Limitations on High Frequency Trading Profitability.” 2010. PDF. http://web.eecs.umich.edu/~kulesza/pubs/hft_jot10.pdf Pages 1-2.

  [6] Intro to Economics: in perfect competition, profits are zero. This makes sense; if a HFT firm makes millions then other firms (or new entrants) are interested in joining the same industry. Not to say the HFT industry is perfectly competitive—your average Joe (or this writer) can’t buy a radio tower or a giant fiber optic line—but the rule, in this case, means that competitors will also increase their speed and any single HFT firm’s competitive edge will be reduced.

  [7] Kearns, Michael and Nevmyvaka, Yuriy. “Machine Learning for Market Microstructure and High Frequency Trading.” 2013. PDF. https://www.cis.upenn.edu/~mkearns/papers/KearnsNevmyvakaHFTRiskBooks.pdf Pages 1-2.

  [8] A four cent profit isn’t exactly much to write home about, but let’s say this was 200 shares. A respectable $8 profit. Let’s multiply this by hundreds, thousands, millions of transactions, and suddenly the 4 cent profit is looking quite respectable indeed.

  [9] “Equity.” Investopedia.com. Web. 10 Aug. 2015. http://www.investopedia.com/terms/e/equity.asp   

  [10] Salomon Brothers went under in 2003 under a storm of scandals. It’s the subject of Lewis’ first book Liar’s Poker.

  [11] In 2014, Virtu reported it made money every trading day.

  [12] You are, of course, a layman who invests in index funds, mutual funds, and the odd ETF, without really understanding what’s going on there.

  [13]“Empirical Limitations on High Frequency Trading Profitability.” Pg. 13-14.

  [14] Front running, which is entirely illegal, is the practice of trading on information before it becomes fully public

  [15]If you are ever enticed by brokerages advertising a one-second execution time, I’d suggest taking a more fundamentals-type approach. In one millisecond hundreds of orders have already been placed, canceled, and fulfilled.

Student Blog Disclaimer
  • The views expressed on the Student Blog are the author’s opinions and don’t necessarily represent the Penn Wharton Public Policy Initiative’s strategies, recommendations, or opinions.


  • <h3>Federal Reserve Economic Data (FRED®)</h3><p><strong><img width="180" height="79" alt="" src="/live/image/gid/4/width/180/height/79/481_fred-logo.rev.1407788243.jpg" class="lw_image lw_image481 lw_align_right" data-max-w="222" data-max-h="97"/>An online database consisting of more than 72,000 economic data time series from 54 national, international, public, and private sources.</strong> FRED®, created and maintained by Research Department at the Federal Reserve Bank of St. Louis, goes far beyond simply providing data: It combines data with a powerful mix of tools that help the user understand, interact with, display, and disseminate the data.</p><p> Quick link to data page: <a href="http://research.stlouisfed.org/fred2/tags/series" target="_blank">http://research.stlouisfed.org/fred2/tags/series</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>Internal Revenue Service: Tax Statistics</h3><p><img width="155" height="200" alt="" src="/live/image/gid/4/width/155/height/200/486_irs_logo.rev.1407789424.jpg" class="lw_image lw_image486 lw_align_left" srcset="/live/image/scale/2x/gid/4/width/155/height/200/486_irs_logo.rev.1407789424.jpg 2x" data-max-w="463" data-max-h="596"/>Find statistics on business tax, individual tax, charitable and exempt organizations, IRS operations and budget, and income (SOI), as well as statistics by form, products, publications, papers, and other IRS data.</p><p> Quick link to <strong>Tax Statistics, where you will find a wide range of tables, articles, and data</strong> that describe and measure elements of the U.S. tax system: <a href="http://www.irs.gov/uac/Tax-Stats-2" target="_blank">http://www.irs.gov/uac/Tax-Stats-2</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>National Bureau of Economic Research (Public Use Data Archive)</h3><p><img width="180" height="43" alt="" src="/live/image/gid/4/width/180/height/43/478_nber.rev.1407530465.jpg" class="lw_image lw_image478 lw_align_right" data-max-w="329" data-max-h="79"/>Founded in 1920, the <strong>National Bureau of Economic Research</strong> is a private, nonprofit, nonpartisan research organization dedicated to promoting a greater understanding of how the economy works. The NBER is committed to undertaking and disseminating unbiased economic research among public policymakers, business professionals, and the academic community.</p><p> Quick Link to <strong>Public Use Data Archive</strong>: <a href="http://www.nber.org/data/" target="_blank">http://www.nber.org/data/</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>National Center for Education Statistics</h3><p><strong><img width="400" height="80" alt="" src="/live/image/gid/4/width/400/height/80/479_nces.rev.1407787656.jpg" class="lw_image lw_image479 lw_align_right" data-max-w="400" data-max-h="80"/>The National Center for Education Statistics (NCES) is the primary federal entity for collecting and analyzing data related to education in the U.S. and other nations.</strong> NCES is located within the U.S. Department of Education and the Institute of Education Sciences. NCES has an extensive Statistical Standards Program that consults and advises on methodological and statistical aspects involved in the design, collection, and analysis of data collections in the Center. To learn more about the NCES, <a href="http://nces.ed.gov/about/" target="_blank">click here</a>.</p><p> Quick link to NCES Data Tools: <a href="http://nces.ed.gov/datatools/index.asp?DataToolSectionID=4" target="_blank">http://nces.ed.gov/datatools/index.asp?DataToolSectionID=4</a></p><p> Quick link to Quick Tables and Figures: <a href="http://nces.ed.gov/quicktables/" target="_blank">http://nces.ed.gov/quicktables/</a></p><p> Quick link to NCES Fast Facts (Note: The primary purpose of the Fast Facts website is to provide users with concise information on a range of educational issues, from early childhood to adult learning.): <a href="http://nces.ed.gov/fastfacts/" target="_blank">http://nces.ed.gov/fastfacts/#</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>NOAA National Climatic Data Center</h3><p><img width="200" height="198" alt="" src="/live/image/gid/4/width/200/height/198/483_noaa_logo.rev.1407788692.jpg" class="lw_image lw_image483 lw_align_left" srcset="/live/image/scale/2x/gid/4/width/200/height/198/483_noaa_logo.rev.1407788692.jpg 2x, /live/image/scale/3x/gid/4/width/200/height/198/483_noaa_logo.rev.1407788692.jpg 3x" data-max-w="954" data-max-h="945"/>NOAA’s National Climatic Data Center (NCDC) is responsible for preserving, monitoring, assessing, and providing public access to the Nation’s treasure of <strong>climate and historical weather data and information</strong>.</p><p> Quick link to home page: <a href="http://www.ncdc.noaa.gov/" target="_blank">http://www.ncdc.noaa.gov/</a></p><p> Quick link to NCDC’s climate and weather datasets, products, and various web pages and resources: <a href="http://www.ncdc.noaa.gov/data-access/quick-links" target="_blank">http://www.ncdc.noaa.gov/data-access/quick-links</a></p><p> Quick link to Text & Map Search: <a href="http://www.ncdc.noaa.gov/cdo-web/" target="_blank">http://www.ncdc.noaa.gov/cdo-web/</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>The Penn World Table</h3><p> The Penn World Table provides purchasing power parity and national income accounts converted to international prices for 189 countries/territories for some or all of the years 1950-2010.</p><p><a href="https://pwt.sas.upenn.edu/php_site/pwt71/pwt71_form.php" target="_blank">Quick link.</a> </p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>MapStats</h3><p> A feature of FedStats, MapStats allows users to search for <strong>state, county, city, congressional district, or Federal judicial district data</strong> (demographic, economic, and geographic).</p><p> Quick link: <a href="http://www.fedstats.gov/mapstats/" target="_blank">http://www.fedstats.gov/mapstats/</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>Congressional Budget Office</h3><p><img width="180" height="180" alt="" src="/live/image/gid/4/width/180/height/180/380_cbo-logo.rev.1406822035.jpg" class="lw_image lw_image380 lw_align_right" data-max-w="180" data-max-h="180"/>Since its founding in 1974, the Congressional Budget Office (CBO) has produced independent analyses of budgetary and economic issues to support the Congressional budget process.</p><p> The agency is strictly nonpartisan and conducts objective, impartial analysis, which is evident in each of the dozens of reports and hundreds of cost estimates that its economists and policy analysts produce each year. CBO does not make policy recommendations, and each report and cost estimate discloses the agency’s assumptions and methodologies. <strong>CBO provides budgetary and economic information in a variety of ways and at various points in the legislative process.</strong> Products include baseline budget projections and economic forecasts, analysis of the President’s budget, cost estimates, analysis of federal mandates, working papers, and more.</p><p> Quick link to Products page: <a href="http://www.cbo.gov/about/our-products" target="_blank">http://www.cbo.gov/about/our-products</a></p><p> Quick link to Topics: <a href="http://www.cbo.gov/topics" target="_blank">http://www.cbo.gov/topics</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>Federal Aviation Administration: Accident & Incident Data</h3><p><img width="100" height="100" alt="" src="/live/image/gid/4/width/100/height/100/80_faa-logo.rev.1402681347.jpg" class="lw_image lw_image80 lw_align_left" srcset="/live/image/scale/2x/gid/4/width/100/height/100/80_faa-logo.rev.1402681347.jpg 2x, /live/image/scale/3x/gid/4/width/100/height/100/80_faa-logo.rev.1402681347.jpg 3x" data-max-w="550" data-max-h="550"/>The NTSB issues an accident report following each investigation. These reports are available online for reports issued since 1996, with older reports coming online soon. The reports listing is sortable by the event date, report date, city, and state.</p><p> Quick link: <a href="http://www.faa.gov/data_research/accident_incident/" target="_blank">http://www.faa.gov/data_research/accident_incident/</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>HUD State of the Cities Data Systems</h3><p><strong><img width="200" height="200" alt="" src="/live/image/gid/4/width/200/height/200/482_hud_logo.rev.1407788472.jpg" class="lw_image lw_image482 lw_align_left" srcset="/live/image/scale/2x/gid/4/width/200/height/200/482_hud_logo.rev.1407788472.jpg 2x, /live/image/scale/3x/gid/4/width/200/height/200/482_hud_logo.rev.1407788472.jpg 3x" data-max-w="612" data-max-h="613"/>The SOCDS provides data for individual Metropolitan Areas, Central Cities, and Suburbs.</strong> It is a portal for non-national data made available through a number of outside institutions (e.g. Census, BLS, FBI and others).</p><p> Quick link: <a href="http://www.huduser.org/portal/datasets/socds.html" target="_blank">http://www.huduser.org/portal/datasets/socds.html</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>USDA Nutrition Assistance Data</h3><p><img width="180" height="124" alt="" src="/live/image/gid/4/width/180/height/124/485_usda_logo.rev.1407789238.jpg" class="lw_image lw_image485 lw_align_right" srcset="/live/image/scale/2x/gid/4/width/180/height/124/485_usda_logo.rev.1407789238.jpg 2x, /live/image/scale/3x/gid/4/width/180/height/124/485_usda_logo.rev.1407789238.jpg 3x" data-max-w="1233" data-max-h="850"/>Data and research regarding the following <strong>USDA Nutrition Assistance</strong> programs are available through this site:</p><ul><li>Supplemental Nutrition Assistance Program (SNAP) </li><li>Food Distribution Programs </li><li>School Meals </li><li>Women, Infants and Children </li></ul><p> Quick link: <a href="http://www.fns.usda.gov/data-and-statistics" target="_blank">http://www.fns.usda.gov/data-and-statistics</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>
  • <h3>The World Bank Data (U.S.)</h3><p><img width="130" height="118" alt="" src="/live/image/gid/4/width/130/height/118/484_world-bank-logo.rev.1407788945.jpg" class="lw_image lw_image484 lw_align_left" srcset="/live/image/scale/2x/gid/4/width/130/height/118/484_world-bank-logo.rev.1407788945.jpg 2x, /live/image/scale/3x/gid/4/width/130/height/118/484_world-bank-logo.rev.1407788945.jpg 3x" data-max-w="1406" data-max-h="1275"/>The <strong>World Bank</strong> provides World Development Indicators, Surveys, and data on Finances and Climate Change.</p><p> Quick link: <a href="http://data.worldbank.org/country/united-states" target="_blank">http://data.worldbank.org/country/united-states</a></p><p>See all <a href="/data-resources/">data and resources</a> »</p>