The Metatrader 5 Series When Huge Backtesting Differences Appear

If you look at my last few weeks of posts I have been very excited about the new qualities of the Metatrader 5 trading platform and the benefits it brings to system development regarding faster execution, faster optimization and added flexibility. Using my prototype implementation of Watukushay FE I analyzed trading over several different instruments and I finally came up with the "starting point" of intra-currency trading for this well-known freely available trading machine. This week I decided to do a small experiment and compare my results of Watukushay FE for the AUD/USD on Metatrader 5 with those found out with Metatrader 4 and the results found were extremely surprising. On todays post I want to talk about my findings, the possible causes of the issues found and what I will be doing to investigate the nature of this problem and what solutions can be implemented to deal with it.

During the first post comparing Metatrader 4 with 5 and the backtesting results of Watukushay FE we already saw a small yet noticeable difference between the testing results obtained on both trading platforms. I talked about the possibility of these errors being feed-related and the fact that the Metatrader 5 history feed might be more reliable since it has been "remastered and fixed" for this new platform. However the difference was small and therefore there was no substantial issue besides an anecdotical note pointing out this curious fact.

However when I decided to run the initial AUD/USD tests on Metatrader 4 to compare the results I obtained with Metatrader 5 the difference changed from "noticeable" to "abismal". The pictures below show you the results for MT5 and MT4 using the exact same settings on the AUD/USD currency pair backtest from 2000 to 2010. The overall equity curve is very different and the results do point out that something is substantially very changed between the historical feeds of MT4 and MT5. I first thought that the difference would be due to the presence of Sunday candles but this turned out to be false since the MT5 feed doesnt have any of them, so regarding this aspect it is the same as MT4. I then thought about the possibility that the whole difference is caused by important changes in data prior to 2006 (before metatrader 4 was launched) and the fact is that data differences are NOT limited to pre 2006 periods, the whole historical feed is different between both trading stations and meaningful differences are present. If you analyze the results youll notice that almost all candles have different - if only very slightly - high/low/open/close values pointing out that RSI and ATR values will be very different. The change in one minute interpolation mechanisms is also not likely a factor here as Watukushay FE strictly controls bar opening on both its MQL4 and MQL5 implementations.
--
What causes such a dramatic change in profitability ? To get to the bottom of this problem I decided to strip down the logic to its simplest form and eliminate the closing logic of the EA, leaving only the entry rules. This shows us that there is still some difference between backtesting results (shown below). This means that differences in results are caused by differences in the RSI and ATR indicator calculations which are dependent on each backtests particular historical feed. Stripping down the logic does reveal that most dependency is located before 2002 with results beyond this date being in better agreement. However there is still some dependency which is caused by differences in data between both historical sets beyond this period.
--
Since we simply cannot know for sure which of the two historical data selections is better - and they are probably both valid within normal broker differences (with the 2000-2002 data being very different probably due to differences between feeds in this period) - it becomes a wise decision to run backtests on both and trust the less profitable results to calculate profit and draw down targets. In some cases like the EUR/USD backtests this proves to be trivial but on others like the one I showed you today doing this mixed analysis proves to be extremely important. I will email the people at metaquotes to get some information about the different nature of the feeds and I will let you know once I have more information about their origin. However up until now all backtests of Watukushay FE seem to be more profitable on MT5 (meaning that our MT4 simulations are in fact the worst case scenario). Investigating other issues which may be related with the closing mechanism of orders in MT5 is also something I am currenlty doing since I have seen that the differences when the closing logic is enabled seem to have other strong causes besides simple feed dependency (more on this on a later post !).

If you would like to learn more about automated trading, the evaluation of expert advisors and the programming of your own strategies please consider buying my ebook on automated trading or joining Asirikuy to receive all ebook purchase benefits, weekly updates, check the live accounts I am running with several expert advisors and get in the road towards long term success in the forex market using automated trading systems. I hope you enjoyed the article !

Diposting oleh Unknown 16.31 0 komentar

Why There is No Universal System Differences Between Currency Pairs

Can we build a system that trades successfully on all forex currency pairs ? This has often been a question of the automated trading system world that simply asks if there is a universal inefficiency, an inefficiency that is so common that it can be found an exploited on all different currency pairs. Up until now, the answer to this question has been a resounding and unequivocal NO. To the best of my knowledge no system has ever been developed to work on all currency pairs despite the claims of many system sellers who tell you that you can use their systems on all of them. But why has it been impossible to build such a system ? Why does trading all currency pairs seems like such a big challenge ? The answer lies within the very fabric of the market and the way in which the different currency pairs trade and react. Within the following paragraphs I will explain to you some of the basic aspects of these currency pair differences and why it makes the creation of any universal system extremely hard if not impossible.

You may have been told that inefficiencies in the market arise due to crowd behavior- which is a human characteristic- and that all currency pairs in forex show it to some degree. When you hear this it becomes easy to think that if a system "really works" then it is bound to work on absolutely all the instruments available in the currency market. After all, every instrument is bought and sold by humans and this would make them inherently inefficient.

Certainly if all instruments traded with the exact same number of people and with the exact same objectives we would be able to easily find a universal inefficiency but the matter of fact is that this is not the case. The first dramatic difference between instruments is the number of participants and the inherent liquidity of each currency pair. Some pairs like the EUR/USD are very liquid while others like the GBP/CHF dont have 1/10th of the liquidity of the former so their price action is dramatically different and the inefficiencies within it become dramatically different. The less people who trade a given pair, the more efficient it becomes since crowd behavior becomes less pronounced and individual decisions start to play important roles.

Then we have other differences that also make the movements of currency pairs different. For example if you are trading the USD/JPY and there is a negative trade balance against Japan then there will be a given fixed amount of money each month that will pull the USD against the JPY just merely because of business transactions that have nothing to do with speculation. The volume of these transactions is very significant and the time in which they are processed and their magnitude will have an impact on the way in which a pair moves.

Many other factors such as central bank intervention and even cultural differences play an important role in the way in which a pair moves when compared to another and all of these factors help to explain why the finding of universal inefficiencies is so hard. However when you look at higher time frames (daily and beyond) there seems to be some coherence and this is the reason why some systems that target month or year long trends manage to exploit the same inefficiency on several different currency pairs. However the success of these systems along the whole portfolio is never total and more often than not there are very strong differences between the profitability of different currency pairs and several pairs where the systems simply do not work.

So will we ever find a global and total inefficiency ? I would have to say that probably no, but if there is a chance it will take a lot more liquidity on all instruments and a lot more market participants to make this the case. Certainly in the future if the market volume on the illiquid currency pairs increases enough we might be able to have - even though not a truly universal system - at least systems that will have better success along different currency pairs.

If you would like to learn more about system development and how you too can build your own likely long term profitable systems based on sound trading tactics please consider buying my ebook on automated trading or joining Asirikuy to receive all ebook purchase benefits, weekly updates, check the live accounts I am running with several expert advisors and get in the road towards long term success in the forex market using automated trading systems. I hope you enjoyed the article !

Diposting oleh Unknown 13.30 0 komentar