Dynasty Posting Utility
 

I am using this thread space to develop and test a web based utility I am writing to help with dynasty posting. At first I was thinking I would use boxscores to generate a lot of this data, but I think I am going to use game logs instead. Everything that happened in the game is in the game logs and thats what TCY and FOF use to generate their box scores with ayway.

If any of the dynasty posters are reading this what kind of information that isn't easily accessible now or not accessible at all would you like to see this program produce? One thing I was considering since FOF doesn't do is produce stats broken down by quarter. And I plan on having the utility produce output both in HTML format and in a format that can be posted on this board.

Anyway I will probably be doing some testing in this thread. Playing with formats etc. So if anyone has any suggestions or requests etc just let me know.

Notes of requests from old board.

DataKing - I haven't messed around with FOF4 yet, so I am not sure if is in that game, but I always thought that statistics based on down and distance would be helpful. Particularly for quarterbacks. How well does that stud QB of yours perform on 3rd and 4-7, 3rd and 8-10, 3rd and 11+.

cthomer - combined offensive yardage (rushing and receiving), all-purpose yardage, FG breakdown by distance

Kodos - how many geriatrics my stud TE has bagged throughout the season

QuikSand - something that gave a quick sense of the league leaders in various categories would be pretty useful

brkt64 - stat pages on players and the records pages, # of 100 yard games for receivers and rushers and 300 yard games for passers would be nice.

Allright I haven't had a lot of time to work on this the last few dyas, but I had a little time this morning and here is what I have so far. I'ver got my first stat that FOF doesn't track. :)

QB 13 Warner, STL

         Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall  43      26      313      60.5  3     2      37    9    34.6  2     2     86.7    

Edit: Man computing the QB rating is insane. How did they come up with that formula?

1st = Number of passes the resulted in 1st down.
1st% = Percentage of completed passes that resulted in 1st down.
Big = Number of completed passes that were over 25 yards.

I am REALLY looking forward to this finished produce!

QB, 13 Warner, St. Louis

          Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall   41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

Not much looks like ti has changed, but I re-wrote a lot of the code in a more efficent manner. Plus as you'll notcie some the stats are slightly different. I fixed a bug that was adding the stats from penalties into the total. So now the stats are accurate.

I also fixed a small bug where not all of the 1st down plays were being recorded.

QB, 13 Warner, St. Louis

          Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall   164     96      1213     58.5  11    5      54    48   50.0  8     17    91.3

Home      55      27      325      49.1  2     3      37    16   59.3  3     6     57.0

Road      109     69      888      63.3  9     2      54    32   46.4  5     11    108.7

Allright I am making some progress now. :)

I have added Home and Away splits for the QB stats now.

As you can see Warner has been much better on the road so far. :)

Man, there is SOOO much potential for stat analysis being able to track stuff like this!

This is going to be some incredible stuff, Primelord. I'd like it just to analyze my own data, even without making a posted dynasty.

Thats a good point. Right now when it outputs the data it outputs it with the tags that are needed to make it look pretty on the board. I need to think about adding the ability to just putput the information to a plain text file for non dynasty posting stuff.

QB, 13 Warner, St. Louis

          Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall   164     96      1213     58.5  11    5      54    48   50.0  8     17    91.3

Home      55      27      325      49.1  2     3      37    16   59.3  3     6     57.0

Road      109     69      888      63.3  9     2      54    32   46.4  5     11    108.7

AFC       41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

NFC       123     71      905      57.7  8     3      54    36   50.7  6     15    92.4

Ok a few more splits for you.

As you can see it now breaks out AFC and NFC stats.

I hope this project is not dying out!!! It seems so awesome!!! Whats the deal primelord? I know you are working your ass off...keep us posted.

Oh this is gonna be good, I may have to start my first Dynasty thread once this gets to a "public" state. Keep it up.

Just curious, did someone suggest tracking "all-purpose" yards or "yards from scrimmage"?

How about including games played in the player stat splits? In case of injuries, etc., It'd be nice to know how many games he played home vs. road, AFC vs. NFC, etc. . .

The project isn't dying out. I just have been busy at work. :) No worries I am still working on it.

cthomer did suggest adding all-purpose yards and I will do that. I was also thinking that games played should be included. That will be in the next update.

Any idea when this thing will make it to the "testing stage"? For some of us I mean?

I was thinking about that. There isn't a lot of reason why it can't be made available for testing now. I guess the only problem is I am going to be changing stuff a lot. But really the only difference will be you mught get more stats then you thought you would from time to time.

I haven't written the web interface for it yet. But that shouldn't take very long. I think I will tackle that next and then you guys can start playing around with it.

Awesome!!!! Thanks.....will this work with more than just FOF4?

Something like this would have been great for my Five Great Men Dynasty. To bad I am using FOF2001

I was going to mention this as I was reading it.. being the PHP-Head that I am, it would b enice to have this in a db/be able to import it into a db to formulate the stats that I would like that are not included, without doing it manually..

Man.. I need to load up FOF4 and start playing so that I can use this for a dynasty..

To be honest I don't know if it will work with FOF2001 or not. It really depends on how much Jim has changed the format of the log files. I don't have 2001 installed anymore. If you want to e-mail me a copy of a .flg file I will take a look and see if it works. [email protected]

FBPro,

As I said above I am not sure if it works with FOF2001 or below, but with a few tweaks it should work fine with TCY. The formats of the files are the same I just need to add switches that report things like stats against the Big XII as opposed to stats against the AFC etc.

Edit: Forgot to put my e-mail address in the text.

I haven't finished the web interface yet, but here are a couple more things I have added. I fixed another bug I found where it was still counting the stats for some plays the resulted in a penalty. I hope I have them all out now. I added the game played for each split as requested. And I added a split for stats versus the players own division.

QB, 13 Warner, St. Louis

          G    Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall   5    162     95      1203     58.6  10    5      54    48   50.5  8     17    89.6





Home      2    54      27      325      50.0  2     3      37    16   59.3  3     6     58.0

Road      3    108     68      878      63.0  8     2      54    32   47.1  5     11    105.4





AFC       1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

NFC       4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Own Div   1    32      22      324      68.8  4     0      54    10   45.5  3     2     143.2

PL,

Looks fantastic, can't wait to give it a whirl.

primelord, how do you go about figuring out the structure of these files? It seems like several people on this board have the ability to figure out the structure of the log files, draft files, etc. I was wondering how you did it.

Sent

The format of the log files is a lot easier to figure out than the format of the draft files and some of the other file formats some of the guys here have cracked. They have to hex edit those files to vigure out the values.

For the log files it's pretty easy. They are just plain text files, but Jim uses symbols thoughout the file that mean different things. For example a -- in the file means the previous play resulted in a first down. A ! is a change of possesion. A * means the beginning of an offensive series for the away team and a $ means the beginning of an offensive series for the home team. Things like that. You just kind of read through the log and you start to get a sense of what those symbols stand for.

It looks like there are a couple minor differences in the 2001 and FOF4 log files. With a few tweaks I think I can get it to read both. I'll let you know if I get that added.

Prime,

Have you thought about making this a hack for the Board?

That shouldn't be a problem. At the very least I should be able to produce the output in a .csv file, but can probably produce it in some of the common db formats too.

I don't know how to do that? Can I do it given that the board is in PHP, but the code is in Perl?

A few more goodies to look at. I have added splits for the players stats in Wins or Ties and in Losses.

QB, 13 Warner, St. Louis

           G    Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall    5    162     95      1203     58.6  10    5      54    48   50.5  8     17    89.6





Home       2    54      27      325      50.0  2     3      37    16   59.3  3     6     58.0

Road       3    108     68      878      63.0  8     2      54    32   47.1  5     11    105.4





AFC        1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

NFC        4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Own Div    1    32      22      324      68.8  4     0      54    10   45.5  3     2     143.2





Wins\Ties  3    99      62      794      62.6  9     3      54    31   50.0  6     8     105.4

Losses     2    63      33      409      52.4  1     2      37    17   51.5  2     9     64.8

And a couple more splits. It now tracks performances based on games that were within a TD. Within 2 TD's and over 2 TD's.

QB, 13 Warner, St. Louis

                G    Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall         5    162     95      1203     58.6  10    5      54    48   50.5  8     17    89.6





Home            2    54      27      325      50.0  2     3      37    16   59.3  3     6     58.0

Road            3    108     68      878      63.0  8     2      54    32   47.1  5     11    105.4





AFC             1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

NFC             4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Own Div         1    32      22      324      68.8  4     0      54    10   45.5  3     2     143.2





Wins\Ties       3    99      62      794      62.6  9     3      54    31   50.0  6     8     105.4

Losses          2    63      33      409      52.4  1     2      37    17   51.5  2     9     64.8

Final Scr 0-7   4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Final Scr 8-14  0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

Final Scr 15+   1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

Honestly I haven't hacked up this software, but there probably has to be atleast some PHP involved.. I don't know if you could meld the two.. If I have time this weekend, I'll look into it.. if there would be a way to make the frontend PHP and the backend Perl, me or someone else could just do the frontend half of it...

Also.. this is just AWESOME... I can't wait for the final results.. Even with copying and pasting it will be great..

How is the interface for this going to work? Is it just going to make a bunch of text files, will there be options, or what?

"They have to hex edit those files to vigure out the values."

Yeah, that's what I figured they did. Was just checking to see if there was another way peopel did it.

primelord:

Maybe you could consider putting in an option for games like down at halftime, down after 3 quarters, etc.?

It'd be useful for only quarterbacks (pretty much), but still might be neat.

~rpi-fan

Thanks.

I haven't really thought out all the details on the different outputs. My original plan was to put two options. One that just produced a pretty html page for you to look at incase you were using it for your own info and not for a dynasty post. And a second option that would give you output suitable to be cut and pasted into the forum.

But now I think I will add the option to produce some text files you can download and probably some .csv files so they can be imported into various other programs. I'd also like to add teh ability to cross reference your roster file to get the full names and some other info. I have a lot of ideas. :)

More splits have been added. The new splits break down the stats by down. I am going to break those up even further to give situational downs. But here is what I have so far.

QB, 13 Warner, St. Louis

                G    Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall         5    162     95      1203     58.6  10    5      54    48   50.5  8     17    89.6





Home            2    54      27      325      50.0  2     3      37    16   59.3  3     6     58.0

Road            3    108     68      878      63.0  8     2      54    32   47.1  5     11    105.4





AFC             1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

NFC             4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Own Div         1    32      22      324      68.8  4     0      54    10   45.5  3     2     143.2





Wins\Ties       3    99      62      794      62.6  9     3      54    31   50.0  6     8     105.4

Losses          2    63      33      409      52.4  1     2      37    17   51.5  2     9     64.8

Final Scr 0-7   4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Final Scr 8-14  0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

Final Scr 15+   1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3





1st Down        5    62      33      500      53.2  1     1      43    18   54.5  4     5     78.7

2nd Down        5    52      29      341      55.8  8     2      35    9    31.0  2     6     111.1

3rd Down        5    46      32      363      69.6  1     2      54    21   65.6  2     6     82.1

4th Down        3    2       1       -1       50.0  0     0      0     0    0.0   0     0     41.7

Now it's getting good. I love situational stats.

Ok I have added situational stats for each down now.

QB, 13 Warner, St. Louis

                G    Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall         5    162     95      1203     58.6  10    5      54    48   50.5  8     17    89.6





Home            2    54      27      325      50.0  2     3      37    16   59.3  3     6     58.0

Road            3    108     68      878      63.0  8     2      54    32   47.1  5     11    105.4





AFC             1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

NFC             4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Own Div         1    32      22      324      68.8  4     0      54    10   45.5  3     2     141.1





Wins\Ties       3    99      62      794      62.6  9     3      54    31   50.0  6     8     105.4

Losses          2    63      33      409      52.4  1     2      37    17   51.5  2     9     64.8

Final Scr 0-7   4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Final Scr 8-14  0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

Final Scr 15+   1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3





1st Down All    5    62      33      500      53.2  1     1      43    18   54.5  4     5     78.7

1st and 0-2     0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

1st and 3-7     0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

1st and 8-10    5    59      32      485      54.2  1     1      43    18   56.2  4     5     80.1

1st and 11+     1    3       1       15       33.3  0     0      15    0    0.0   0     0     50.7





2nd Down All    5    52      29      341      55.8  8     2      35    9    31.0  2     6     99.4

2nd and 0-2     4    6       4       71       66.7  4     0      35    0    0.0   2     0     146.5

2nd and 3-7     4    10      4       24       40.0  1     1      11    2    50.0  0     0     41.7

2nd and 8-10    5    23      13      141      56.5  3     1      24    2    15.4  0     5     96.2

2nd and 11+     5    13      8       105      61.5  0     0      19    5    62.5  0     1     87.0





3rd Down All    5    46      32      363      69.6  1     2      54    21   65.6  2     6     82.1

3rd and 0-2     3    4       2       13       50.0  0     0      9     2    100.  0     1     57.3

3rd and 3-7     5    12      9       124      75.0  1     0      54    9    100.  1     1     135.4

3rd and 8-10    5    16      12      123      75.0  0     1      19    6    50.0  0     0     70.6

3rd and 11+     5    14      9       103      64.3  0     1      27    4    44.4  1     4     56.5





4th Down All    3    2       1       -1       50.0  0     0      0     0    0.0   0     0     56.2

4th and 0-2     1    1       1       -1       100.  0     0      0     0    0.0   0     0     79.2

4th and 3-7     1    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

4th and 8-10    1    1       0       0        0.0   0     0      0     0    00.0  0     0     39.6

4th and 11+     0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

*drool*

Not being pushy here.. any idea when you'll have a "final" (i'm sure it will never be final) release? I want to start up a dynasty post this weekend, but I may delay until you finish :)

Great job primelord.

I don't think there is a way to tell which defensive players are on the field at one time is there? I would love to know stats like YPC with this DT in the lineup.

Todd

Like you said I am not sure it will ever be final. The code itself is ugly as sin. It started out pretty concise, but as I have added all of these pieces it's pretty sloppy, but effective. :) I can see several places I can rewrite to 1) make the code easier to read and 2) make it run faster, but I will wait to do that until after I have all the features in place.

I am not sure that it is extremely useful at the moment. It only reads QB stats right now. Thats why you keep seeing shots of Warner. : ) But most of the code will be recycled for the other positions so it shouldn't take long to add those.

For those that want to install ActivePerl on your Windows machines I would say you can probably have a copy of what I have so far as early as tonight when I get home. But if you aer waiting for the web interface then it may be a couple more days still.

Yea there really isn't anyway to determine that from the Logs since they only mention the defender that was involved in the play. So for example if your game plan is to run away from Warren Sapp. I can't tell you if Sapp was on the field or not unless he makes the tackle.

I'm not in a huge hurry.. I'm fine with activeperl, but I'd just assume wait until it atleast does all of the positions... It's not like I can't implement it partway through my dynasty anyways ;)

Ok a few more splits. It now displays stats broken down by half and by quarter.

QB, 13 Warner, St. Louis

                G    Att     Cmp     Yards    Prct  TD's  Int's  Long  1st  1st%  Big   Sack  Rate

Overall         5    162     95      1203     58.6  10    5      54    48   50.5  8     17    89.6





Home            2    54      27      325      50.0  2     3      37    16   59.3  3     6     58.0

Road            3    108     68      878      63.0  8     2      54    32   47.1  5     11    105.4





AFC             1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3

NFC             4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Own Div         1    32      22      324      68.8  4     0      54    10   45.5  3     2     141.1





Wins\Ties       3    99      62      794      62.6  9     3      54    31   50.0  6     8     105.4

Losses          2    63      33      409      52.4  1     2      37    17   51.5  2     9     64.8

Final Scr 0-7   4    121     70      895      57.9  7     3      54    36   51.4  6     15    90.1

Final Scr 8-14  0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

Final Scr 15+   1    41      25      308      61.0  3     2      37    12   48.0  2     2     88.3





1st Down All    5    62      33      500      53.2  1     1      43    18   54.5  4     5     78.7

1st and 0-2     0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

1st and 3-7     0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

1st and 8-10    5    59      32      485      54.2  1     1      43    18   56.2  4     5     80.1

1st and 11+     1    3       1       15       33.3  0     0      15    0    0.0   0     0     50.7





2nd Down All    5    52      29      341      55.8  8     2      35    9    31.0  2     6     99.4

2nd and 0-2     4    6       4       71       66.7  4     0      35    0    0.0   2     0     146.5

2nd and 3-7     4    10      4       24       40.0  1     1      11    2    50.0  0     0     41.7

2nd and 8-10    5    23      13      141      56.5  3     1      24    2    15.4  0     5     96.2

2nd and 11+     5    13      8       105      61.5  0     0      19    5    62.5  0     1     87.0





3rd Down All    5    46      32      363      69.6  1     2      54    21   65.6  2     6     82.1

3rd and 0-2     3    4       2       13       50.0  0     0      9     2    100.  0     1     57.3

3rd and 3-7     5    12      9       124      75.0  1     0      54    9    100.  1     1     135.4

3rd and 8-10    5    16      12      123      75.0  0     1      19    6    50.0  0     0     70.6

3rd and 11+     5    14      9       103      64.3  0     1      27    4    44.4  1     4     56.5





4th Down All    3    2       1       -1       50.0  0     0      0     0    0.0   0     0     56.2

4th and 0-2     1    1       1       -1       100.  0     0      0     0    0.0   0     0     79.2

4th and 3-7     1    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0

4th and 8-10    1    1       0       0        0.0   0     0      0     0    00.0  0     0     39.6

4th and 11+     0    0       0       0        00.0  0     0      0     0    00.0  0     0     00.0





1st Half        5    85      51      705      60.0  6     3      54    25   49.0  5     12    95.5

2nd Half        5    77      44      498      57.1  4     2      41    23   52.3  3     5     83.1





1st Quarter     5    35      20      225      57.1  2     3      43    10   50.0  1     8     59.8

2nd Quarter     5    50      31      480      62.0  4     0      54    15   48.4  4     4     120.4

3rd Quarter     5    39      25      296      64.1  1     1      41    15   60.0  2     3     85.0

4th Quarter     5    38      19      202      50.0  3     1      37    8    42.1  1     2     81.2

How about home/away/1st down/2nd down/3rd down/4th down by quarter?

Just kidding, of course. ;)

It looks awesome and I can't wait to see/try the first beta!:)

Keep up the great work!

bump, before it goes to page 2. :)

I haven't made much progress on this lately, but don't worry I am not done. :)

WORD UP!

I like big butts and I can not lie!