Designing the engine alongside agents
The key issues so far have been in designing the engine alongside agents. I have now got this set up largely as I want it, at least directionally.
The datasets have been part of the challenge. I mentioned provenance of data as key early on, and that led the agents down a very strict path of not enabling certain datasets until they were verified and authorised for use. That was the right instinct early on so it didn’t spiral, but it also starved the system of material it needed day to day.
I have been changing some of the methods for how we use the data. I have maintained the core deterministic engine that evaluates the gathered statistics. The harder part has been the unstructured side. Early on I put too much emphasis on provenance there as well, and that led to limited data coming in from automated agent search each day. I am now looking at this as gathering as much as possible, submitting it to the ledger, and letting an agent use that alongside its own search to make decisions on the starting team for GW1.
Early issues were the kind of thing that looks small in a design doc and large when you see a proposed fifteen, you start realising what its missing or not utilsing properly. An absence of Haaland in line-ups as an exmaple. World Cup fatigue was over-indexed (which was a passing includsion) and I am feeling that is not really worth including as a hard prior; a tiny detail amongst a lot of more significant data. The model did not properly consider opportunity cost either. Those are the sorts of corrections I would rather make now, before a live deadline, than explain afterwards.
I am currently planning around GW1–6, with the agents proposing the final team selections and updates coming in daily after the research agent has pulled in new data. I will be inputting the team, but I am trying to dial this in as much as I can now so I do not doubt its choices further down the line, and so I know I have given it the best chance to make a decision. I still feel some way from that, but there are still about three weeks to season start.