Welcome to the FTS Forum - Read the introduction here

Avatar
Please consider registering
Guest
Search
Forum Scope


Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Feed
Topic Rating: +4 Topic Rating: +4 (4 votes) 
sp_TopicIcon
Taking data analysis to the next level?
sp_NewTopic Add Topic
Avatar
LONDON / ATX
Beginner
Members
Forum Posts: 35
Member Since:
January 20, 2019
sp_UserOfflineSmall Offline
1
November 20, 2019 - 1:28 pm
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Hey gang,

I like to think of myself as an enthusiastic newbie around these parts. I have a few thousand rows of filterable data at this point (mainly FDD and some others) and I’m thinking of ways to take the analysis of this raw data to the next level.

Are pivot tables the answer I’m looking for? If not, what’s next?

Always learning...

Avatar
Beginner
Members
Forum Posts: 13
Member Since:
August 2, 2013
sp_UserOfflineSmall Offline
2
November 20, 2019 - 5:38 pm
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Hi Callum

Having thousands of rows of data from FDD or another source can be very exciting and you can become engrossed in the sheets for days on end looking for profits. One thing I would say is be wary of over filtering and essentially removing as many losers as possible or finding a seemingly profitable angle and jumping in right away for real money.
Pivot tables can be very useful if you know what you’re doing and can help narrow things down in terms of what you are looking for or possible niche angles (presuming you are an Ultimate member check out the pivot table analysis video for example).
I would try focus on one type of market firstly and decide whether you want to look at backing or laying as of course these bring totally different elements into the mix (backing; what odds are you looking at and what sort of winning/losing runs do you get as a result whereas with laying you can go 7,8,9 winners in a row then hit two quick losers in succession and while on a spreadsheet it all seems easy doing it in real time and finding a weekend’s profit wiped out in two bets can take a bit of getting used to).
Have you looked at any specifics yet or just looking for somewhere to start?

The following users say thank you to marko25 for this useful post:

bettyblogger, Callum
Avatar
LONDON / ATX
Beginner
Members
Forum Posts: 35
Member Since:
January 20, 2019
sp_UserOfflineSmall Offline
3
November 22, 2019 - 3:55 pm
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Thank you Marko, appreciate the response. The pitfalls of over flitering and trying to make the data fit what you’re looking for is already something I am actively trying to avoid.

 

I’m not coming at this from an angle of trying to find perfect systems, I’m just looking for ways to make analysis of these vast sums of data more efficient and less time consuming. I don’t have the luxury of many extra hours in my working week to study rows upon rows of data so I’m looking for ways to speed up my processes to get a firmer understanding of the data sets.

Always learning...

Avatar
Beginner
Members
Forum Posts: 27
Member Since:
August 2, 2013
sp_UserOfflineSmall Offline
4
November 22, 2019 - 4:56 pm
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

I’ve always wondered if there was a way in Excel or using Excel data whereby one can effectively reverse the process to find systems.

Quite hard to articulate, but effectively, you have your large data set and you ask Excel “find me the highest cumulative sums of profit by filtering the data across X fields” and it somehow returns the ranges / selections across those fields to arrive at those sums.

Not sure if Excel, or any software we can get our hands on, has the intelligence to do that…….anyone?

Avatar
Beginner
Members
Forum Posts: 30
Member Since:
July 31, 2019
sp_UserOfflineSmall Offline
5
November 22, 2019 - 6:36 pm
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

I’ve wondered that too. I think Excel has a solver add-in which might be useful, but I’ve not really looked into it.

What I have done for the FTS sheets is write some scripts, much like the horse racing RAP tool, where I can set a range of different filters and it scans all the different combinations. Much quicker than manually setting filters to find systems.

Avatar
Beginner
Members
Forum Posts: 85
Member Since:
October 23, 2019
sp_UserOfflineSmall Offline
6
November 23, 2019 - 12:49 am
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Nick said
I’ve always wondered if there was a way in Excel or using Excel data whereby one can effectively reverse the process to find systems.

Quite hard to articulate, but effectively, you have your large data set and you ask Excel “find me the highest cumulative sums of profit by filtering the data across X fields” and it somehow returns the ranges / selections across those fields to arrive at those sums.

Not sure if Excel, or any software we can get our hands on, has the intelligence to do that…….anyone?

  

I have looked into this and had someone look at some advanced stepwise regression, it doesn’t really work, or didn’t for me. 

The following users say thank you to Lord Dio for this useful post:

Nick
Avatar
Beginner
Members
Forum Posts: 1
Member Since:
November 1, 2019
sp_UserOfflineSmall Offline
7
February 1, 2020 - 12:29 pm
sp_Permalink sp_Print
+4
sp_QuotePost
sp_ReportPost

Nick said
I’ve always wondered if there was a way in Excel or using Excel data whereby one can effectively reverse the process to find systems.

Quite hard to articulate, but effectively, you have your large data set and you ask Excel “find me the highest cumulative sums of profit by filtering the data across X fields” and it somehow returns the ranges / selections across those fields to arrive at those sums.

Not sure if Excel, or any software we can get our hands on, has the intelligence to do that…….anyone?

  

This is what one of the FTS racing tools offers – you set up the parameters (variables to test (eg. racecourse)) and their range (eg. odds 1.3-1.7), then a macro runs to work through the permutations and return the results (sorted in order of profitability, of course!).  You can test a 1000s of permutations in a few minutes – and of course Excel does the work.

I demo’d the above to somebody who was doing the same kind of analysis using Power Query (a built-in Excel facility) recently – he was impressed with what Excel VBA offered over and above the Excel built-in options.  Ian himself was there to witness the exchange!

It is very difficult to explain (and indeed understand) how Excel VBA can change the game.  You really do not need another piece of software for datasets <500k rows; Excel VBA offers the best balance of coding complexity, versatility and power.

The best way to learn is to work through examples (that’s what I did), feel the power of what is possible (it’s an order of magnitude better than what Excel’s built-in functions offer,) appreciate the possibilities and then start experimenting with your own ideas.

It’s hard work but the pay-off is significant – I think coupled with the right mindset (discipline etc.) it would set anybody up for a serious punting career.

Everything is there, for free on my YouTube channel, and I am putting together a course for football traders that shows you how to do it step-by-step.

Not a regular on the forum so Tweet or email me if you’d like to discuss.

The following users say thank you to chrissy_spreadsheets for this useful post:

Neil, Nick, MikeH, becker, des911, jamiep, leewillo75, Matthew, wils2004
Avatar
Beginner
Members
Forum Posts: 27
Member Since:
August 2, 2013
sp_UserOfflineSmall Offline
8
February 1, 2020 - 12:52 pm
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Hi Chrissy,

Sounds very very interesting indeed.  No issues with learning and teaching myself following videos and stuff online.

I’ve watched a few of your videos to help me develop some of my spreadsheets….could you point me in the right direction of what ones I should watch regarding this.  I wouldn’t even know what I am trying to do is called in Excel in terms of the “method” I am trying to do – e.g. reverse engineer a filter set to arrive at highest value permutations of profit??

Will drop you a mail as definitely interested in learning what you describe – sounds like a game changer.

Thanks,

Nick

Avatar
Beginner
Members
Forum Posts: 32
Member Since:
July 10, 2019
sp_UserOnlineSmall Online
9
February 1, 2020 - 3:56 pm
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Chrissy that course for football traders would be awesome. Please keep us updated as to when it will be available 👍

Avatar
Beginner
Members
Forum Posts: 16
Member Since:
August 22, 2015
sp_UserOfflineSmall Offline
10
February 2, 2020 - 6:16 am
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Looking forward to that football course, Chrissy!

Avatar
Beginner
Members
Forum Posts: 60
Member Since:
August 2, 2013
sp_UserOfflineSmall Offline
11
February 2, 2020 - 8:25 am
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

Anyone know the name of Chrissy on Youtube, I’ve done a search but can’t find it

Avatar
Beginner
Members
Forum Posts: 8
Member Since:
January 16, 2017
sp_UserOfflineSmall Offline
12
February 2, 2020 - 8:43 am
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

des911 said
Anyone know the name of Chrissy on Youtube, I’ve done a search but can’t find it

  

Tiger Spreadsheet Solutions

The following users say thank you to Mark for this useful post:

des911
Avatar
Beginner
Members
Forum Posts: 9
Member Since:
August 4, 2013
sp_UserOfflineSmall Offline
13
February 3, 2020 - 8:37 pm
sp_Permalink sp_Print sp_EditHistory
0
sp_QuotePost
sp_ReportPost

Callum Original poster.

I think what your talking about is What If analysis. Excel has its own Solver addin. That is some reading material for you for own knowledge base to get a very first basic level overview.

Avatar
Beginner
Members
Forum Posts: 5
Member Since:
February 23, 2019
sp_UserOfflineSmall Offline
14
February 4, 2020 - 9:58 am
sp_Permalink sp_Print
0
sp_QuotePost
sp_ReportPost

I was just wondering if anybody uses a database to store their data and use SQL to query the data. I realise learning SQL is a lot harder than filtering in excel but it can be a lot more powerful and efficient in the way the data is queried especially as the amount of data grows.

I would also be very interested in a VBA ‘Football’ course by Chrissy  sounds a very interesting prospect

Forum Timezone: Europe/London
Most Users Ever Online: 92
Currently Online: lovejoyx, daveat91, Neil
3
Guest(s)
Currently Browsing this Page:
1 Guest(s)
Forum Stats:
Groups: 4
Forums: 22
Topics: 173
Posts: 1321

 

Member Stats:
Guest Posters: 3
Members: 4398
Moderators: 1
Admins: 2
Administrators: Ian, Geeky Boy
Moderators: ArtTest