Home · Maps · About

Home > SubChat

[ Post a New Response | Return to the Index ]

[1 2]

 

Page 1 of 2

Next Page >  

(1460921)

view threaded

Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Tue Jan 2 15:51:05 2018

Only 72% of trains scheduled to originate between 6am and 10am, actually made it into service.

Here's the breakdown by line and direction:
1: N: 24 sched, 18 dep, 75 pct; S: 38 sched, 30 dep, 78 pct;
2: N: 26 sched, 19 dep, 73 pct; S: 29 sched, 24 dep, 82 pct;
3: N: 19 sched, 15 dep, 78 pct; S: 24 sched, 16 dep, 66 pct;
4: N: 29 sched, 18 dep, 62 pct; S: 35 sched, 20 dep, 57 pct;
5: N: 25 sched, 19 dep, 76 pct; S: 30 sched, 26 dep, 86 pct;
6: N: 33 sched, 22 dep, 66 pct; S: 19 sched, 14 dep, 73 pct;
6X: S: 23 sched, 19 dep, 82 pct;
7: N: 73 sched, 50 dep, 68 pct; S: 80 sched, 65 dep, 81 pct;
7X: N: 4 sched, 4 dep, 100 pct; S: 27 sched, 10 dep, 37 pct;
A: N: 34 sched, 27 dep, 79 pct; S: 29 sched, 18 dep, 62 pct;
B: N: 20 sched, 16 dep, 80 pct; S: 16 sched, 12 dep, 75 pct;
C: N: 21 sched, 15 dep, 71 pct; S: 15 sched, 11 dep, 73 pct;
D: N: 21 sched, 16 dep, 76 pct; S: 31 sched, 22 dep, 70 pct;
E: N: 32 sched, 24 dep, 75 pct; S: 26 sched, 15 dep, 57 pct;
F: N: 33 sched, 19 dep, 57 pct; S: 33 sched, 25 dep, 75 pct;
G: N: 20 sched, 15 dep, 75 pct; S: 18 sched, 13 dep, 72 pct;
GS: N: 44 sched, 32 dep, 72 pct; S: 43 sched, 30 dep, 69 pct;
J: N: 20 sched, 16 dep, 80 pct; S: 15 sched, 10 dep, 66 pct;
L: N: 35 sched, 29 dep, 82 pct; S: 30 sched, 24 dep, 80 pct;
M: N: 31 sched, 16 dep, 51 pct; S: 35 sched, 25 dep, 71 pct;
N: N: 18 sched, 13 dep, 72 pct; S: 15 sched, 12 dep, 80 pct;
Q: N: 21 sched, 16 dep, 76 pct; S: 21 sched, 12 dep, 57 pct;
R: N: 20 sched, 15 dep, 75 pct; S: 24 sched, 19 dep, 79 pct;
S: N: 18 sched, 14 dep, 77 pct; S: 13 sched, 10 dep, 76 pct;
W: N: 8 sched, 4 dep, 50 pct; S: 9 sched, 6 dep, 66 pct;
Z: N: 6 sched, 5 dep, 83 pct;

For some reason, the gtfs-rt treats Manhattan bound E trains as going northbound. The S is for SIRT and GS is the designation for the 42nd St Shuttle.

I can supply which trains did not go into service, if anyone is interested.


Post a New Response

(1460923)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Tue Jan 2 16:25:31 2018, in response to Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Tue Jan 2 15:51:05 2018.

Hi, Can you supply the 3 & 4, E & Q trains? How were you able to break this data down from the GTFS file?

Post a New Response

(1460925)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Joe V on Tue Jan 2 16:32:19 2018, in response to Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Tue Jan 2 15:51:05 2018.

M is pretty bad. Did they lump the Main Line M and Myrtle Shuttle M into one ?

Post a New Response

(Sponsored)

iPhone 6 (4.7 Inch) Premium PU Leather Wallet Case - Red w/ Floral Interior - by Notch-It

(1460927)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by zac on Tue Jan 2 16:36:59 2018, in response to Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Tue Jan 2 15:51:05 2018.

I don't believe those numbers. Every line would be packed and delays would propagate through the system if this were true. Something is wrong with the methodology.

Post a New Response

(1460929)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by italianstallion on Tue Jan 2 16:38:25 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by zac on Tue Jan 2 16:36:59 2018.

Well, there's a good chance many people were still on vacation today, so ridership is probably lower than normal.

Post a New Response

(1460934)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Tue Jan 2 17:05:28 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Tue Jan 2 16:25:31 2018.

Can you supply the 3 & 4, E & Q trains?

I thought I already did. If you have a specific question, I'll see if I can answer it.

How were you able to break this data down from the GTFS file?

I read the specs (available on the MTA website) and wrote a program to parse the file. It wasn't easy and took 4 iterations to get something that's manageable.

There are several steps.

1. Download the data. Nobody's archiving the real time data, anymore. You have to apply for a developer's key from the MTA. It's automatic, handled over the web and does not cost anything.

1a. There's a ton of data, so I set up a cloud app to download and save it.

There are several steps in making the data useful.

2. The data is serialized to reduce the byte count. There's a free program called protoc that will convert it into readable a readable text file.

3. The text file is in pseudo xml format. I had to write a program that first fixed up the xml and then converted the xml into multiple csv files.

4. I then wrote a program to import the csv files into a relational database.

Post a New Response

(1460936)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Tue Jan 2 17:09:42 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Joe V on Tue Jan 2 16:32:19 2018.

M is pretty bad. Did they lump the Main Line M and Myrtle Shuttle M into one ?

The data is for individual trips. I'm the guy who lumped them and calculated the numbers.

Both the shuttle and the Main Line M have the same route identification. I wrote a quick and dirty SQL that did not distinguish between them. I can get a list of those that did not run. The train id will show which was which.

Post a New Response

(1460940)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Tue Jan 2 17:43:41 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by zac on Tue Jan 2 16:36:59 2018.

Every line would be packed and delays would propagate through the system if this were true.

I have not yet developed any delay analysis. The information is available for a detailed analysis on a train by train basis. It's on my todo list.

Something is wrong with the methodology.

The GTFS-RT feed includes an updated full schedule for every trip from 30 minutes before its departure until it reaches its last stop. The GTFS-RT feed is updated at least once per minute. Once a trip leaves its originating station, its assigned status changes from false to true. I made two lists. The first for all trips that were scheduled to originate between 6am and 9:59:59 am. The second was a list of all trips that were scheduled to originate between 6am and 9:59:59am with an assigned true status. I compared both lists.

Post a New Response

(1460950)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by geoffc on Tue Jan 2 18:43:08 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by zac on Tue Jan 2 16:36:59 2018.

The Q and B had a signal problem this morning Manhattan bound just before Prospect Park station. (I sat for 30 min before they reversed us back to Parkside drive). I was bummed, we did not get to walk on the tracks. I was looking forward to it. So that killed an hour of Q traffic, till they dumped the Q's on the express, I guess by Kings Highway.



Post a New Response

(1460958)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by 7 Local on Tue Jan 2 19:27:42 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by geoffc on Tue Jan 2 18:43:08 2018.

The 7X only had 37% departures this morning? That seems pretty bad since their Twitter doesn't show any SB delays this morning.

Post a New Response

(1460961)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Andrew Saucci on Tue Jan 2 19:51:14 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by zac on Tue Jan 2 16:36:59 2018.

Another possibility is that the schedules on some or all lines are padded with normally unnecessary runs to make sure that even if a large number of runs don't make it out, enough remain to provide decent service. If they pad the running times to maintain high on-time rates, as we all know they do, they could certainly pad the number of runs as well.

Post a New Response

(1460965)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Tue Jan 2 20:19:28 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by 7 Local on Tue Jan 2 19:27:42 2018.

Here's a list of the trips that were cancelled.

"route";"train_id";""sched_dep"
"7";"07 0609+ MST/34H";"0609+"
"7";"07 0617+ MST/34H";"0617+"
"7X";"07 0621 MST/34H";"0621 "
"7";"07 0624 MST/34H";"0624 "
"7";"E7 0625";"0625"
"7X";"07 0628 MST/34H";"0628 "
"7";"E7 0629";"0629"
"7X";"07 0637 MST/34H";"0637 "
"7X";"07 0641 MST/34H";"0641 "
"7";"E7 0646+ QBP/34H";"0646+"
"7";"E7 0647 QBP/34H";"0647 "
"7";"E7 0649+ VER/34H";"0649+"
"7";"E7 0651 HTR/34H";"0651 "
"7X";"07 0651 MST/34H";"0651 "
"7X";"07 0707 MST/34H";"0707 "
"7X";"07 0721 MST/34H";"0721 "
"7";"07 0723 MST/34H";"0723 "
"7X";"07 0729 MST/34H";"0729 "
"7X";"07 0742 MST/34H";"0742 "
"7X";"07 0746 MST/34H";"0746 "
"7X";"07 0750 MST/34H";"0750 "
"7X";"E7 0759 JCT/34H";"0759 "
"7X";"07 0802 MST/34H";"0802 "
"7";"07 0804 MST/34H";"0804 "
"7X";"07 0806 MST/34H";"0806 "
"7X";"07 0814 MST/34H";"0814 "
"7";"07 0816 MST/34H";"0816 "
"7X";"07 0824 MST/34H";"0824 "
"7";"07 0824 WPT/34H";"0824 "
"7";"07 0826+ MST/34H";"0826+"
"7X";"07 0834 MST/34H";"0834 "
"7";"07 0834 WPT/34H";"0834 "

There was something funny going on between 6 and 7am. The E as the first character means it was an extra. There are also some unusual starting terminals: Queensboro Plaza, Vernon, Hunters Point and Junction.

their Twitter doesn't show any SB delays this morning.

It's one of the reasons I don't trust NYCT to be able to audit itself.

Post a New Response

(1460975)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Andrew Saucci on Tue Jan 2 22:40:42 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Tue Jan 2 20:19:28 2018.

This does look a bit weird to me, even given that I am hardly a scheduling expert.

Post a New Response

(1460976)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Tue Jan 2 22:41:15 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Tue Jan 2 17:05:28 2018.

Hi, I meant which trains were "ABD" on those lines

Your steps appear very intense, I'n going to try and do this. Would you assist me, if needed? I already have the files imported into an Excel spreadsheet.

Post a New Response

(1460980)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by randyo on Wed Jan 3 00:02:54 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Andrew Saucci on Tue Jan 2 19:51:14 2018.

Padding the number of runs is highly unlikely since even back when I was in scheduling we often had to schedule fewer runs than necessary simply because there were not enough cars to provide the service that was actually needed. The powers that be in NYCT management did not want to schedule runs that couldn’t be operated since it would not look good for intervals to be dropped for any reason and car equipment definitely did not want to be charged with intervals dropped due to car shortage.

Post a New Response

(1460988)

view threaded

Re: Morning AWOL Report for 2 Jan 2018 - Revised

Posted by Stephen Bauman on Wed Jan 3 07:57:07 2018, in response to Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Tue Jan 2 15:51:05 2018.

I discovered a bug, when making the PM rush hour report. Here are the revised figures for the AM 6-10am period for Jan 2nd.

The bug was unintentionally not including data from after 8am in calculating the awol's. This did two things: it did not include all trips that started after 8am. It also included as awol, trips that actually started after 8am but were included in the 30 minute window before scheduled departure. That bug has been fixed.

The awol rate was 12% or an availability rate of 88%. That's not up to 3 or 4 - 9's (99.9% or 99.99%) availability goals.

"1: N: 55 sched, 53 dep, 96%; S: 61 sched, 61 dep, 100%"
"2: N: 45 sched, 38 dep, 84%; S: 52 sched, 46 dep, 88%"
"3: N: 33 sched, 29 dep, 87%; S: 37 sched, 33 dep, 89%"
"4: N: 56 sched, 39 dep, 69%; S: 53 sched, 41 dep, 77%"
"5: N: 46 sched, 36 dep, 78%; S: 50 sched, 46 dep, 92%"
"6: N: 77 sched, 56 dep, 72%; S: 38 sched, 33 dep, 86%"
"6X: S: 40 sched, 40 dep, 100%"
"7: N: 124 sched, 95 dep, 76%; S: 135 sched, 115 dep, 85%"
"7X: N: 14 sched, 14 dep, 100%; S: 45 sched, 28 dep, 62%"
"A: N: 47 sched, 45 dep, 95%; S: 45 sched, 38 dep, 84%"
"B: N: 33 sched, 30 dep, 90%; S: 25 sched, 24 dep, 96%"
"C: N: 30 sched, 28 dep, 93%; S: 25 sched, 24 dep, 96%"
"D: N: 32 sched, 31 dep, 96%; S: 50 sched, 43 dep, 86%"
"E: N: 49 sched, 45 dep, 91%; S: 49 sched, 41 dep, 83%"
"F: N: 48 sched, 38 dep, 79%; S: 50 sched, 46 dep, 92%"
"G: N: 31 sched, 29 dep, 93%; S: 33 sched, 28 dep, 84%"
"GS: N: 83 sched, 83 dep, 100%; S: 83 sched, 83 dep, 100%"
"J: N: 30 sched, 30 dep, 100%; S: 30 sched, 30 dep, 100%"
"L: N: 60 sched, 60 dep, 100%; S: 40 sched, 40 dep, 100%"
"M: N: 51 sched, 39 dep, 76%; S: 57 sched, 54 dep, 94%"
"N: N: 29 sched, 27 dep, 93%; S: 30 sched, 24 dep, 80%"
"Q: N: 39 sched, 29 dep, 74%; S: 35 sched, 27 dep, 77%"
"R: N: 30 sched, 29 dep, 96%; S: 33 sched, 33 dep, 100%"
"S: N: 21 sched, 21 dep, 100%; S: 17 sched, 17 dep, 100%"
"W: N: 18 sched, 15 dep, 83%; S: 21 sched, 14 dep, 66%"
"Z: N: 6 sched, 6 dep, 100%;"


Post a New Response

(1460990)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Kevin from Midwood on Wed Jan 3 08:06:50 2018, in response to Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Tue Jan 2 15:51:05 2018.

Most of those numbers seem too low. Combined 7 and 7X service looks right: 107 trains scheduled southbound averages out to about 27 TPH. But, for example, the L's "35 sched" northbound is significantly less than what's in the public timetable for that 4-hour period. Did they really change the schedule on the fly from 15+ TPH to less than 9?

Post a New Response

(1460991)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Wed Jan 3 08:10:47 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Tue Jan 2 22:41:15 2018.

I already have the files imported into an Excel spreadsheet.

I don't believe we are talking about the same files. There are more than 5.5 million lines of input data for arrival/departure times by station for the 8 hour that were required to generate the AM rush hour report. There are also 207K different readings for train locations.

I don't use Excel. However, I believe that when faced with such large numbers, its reaction is tilt.

Post a New Response

(1460997)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Kevin from Midwood on Wed Jan 3 09:48:15 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Kevin from Midwood on Wed Jan 3 08:06:50 2018.

Never mind. I hadn't finished composing this message before you posted your correction.

Post a New Response

(1460998)

view threaded

Re: Morning AWOL Report for 2 Jan 2018 - Revised

Posted by zac on Wed Jan 3 09:54:59 2018, in response to Re: Morning AWOL Report for 2 Jan 2018 - Revised, posted by Stephen Bauman on Wed Jan 3 07:57:07 2018.

That makes a lot more sense. Didn't mean to question what you were doing, but something definitely looked wrong about the original list.

Keep posting.

Post a New Response

(1460999)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Wed Jan 3 10:46:57 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Wed Jan 3 08:10:47 2018.

Probably not then, this data is also on the MTA Developer Resource page?

What do you use Access?

Post a New Response

(1461001)

view threaded

Re: Morning AWOL Report for 2 Jan 2018 - Revised

Posted by BusRider on Wed Jan 3 10:55:51 2018, in response to Re: Morning AWOL Report for 2 Jan 2018 - Revised, posted by Stephen Bauman on Wed Jan 3 07:57:07 2018.

Could you post which #4 and "Q" trains did not operate?

Post a New Response

(1461003)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Wed Jan 3 11:02:08 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by randyo on Wed Jan 3 00:02:54 2018.

By chance, Do you recall how many cars there were at that time for each car type? Might be wishful thinking but I wanted to take a chance.

Post a New Response

(1461005)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Wed Jan 3 11:28:22 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Wed Jan 3 10:46:57 2018.

Here's a link to where you start under Developer resources.

What do you use Access?

postgresql.

Post a New Response

(1461007)

view threaded

Re: Morning AWOL Report for 2 Jan 2018 - Revised

Posted by Stephen Bauman on Wed Jan 3 11:39:32 2018, in response to Re: Morning AWOL Report for 2 Jan 2018 - Revised, posted by BusRider on Wed Jan 3 10:55:51 2018.

"4";"NORTH";"04 0607+ NLT/WDL"
"4";"NORTH";"04 0619+ NLT/WDL"
"4";"NORTH";"04 0642 UTI/WDL"
"4";"NORTH";"04 0652 UTI/WDL"
"4";"NORTH";"04 0701+ UTI/WDL"
"4";"NORTH";"04 0704+ UTI/WDL"
"4";"NORTH";"04 0708 NLT/WDL"
"4";"NORTH";"04 0713+ UTI/WDL"
"4";"NORTH";"04 0719+ UTI/WDL"
"4";"NORTH";"04 0734+ UTI/WDL"
"4";"NORTH";"04 0741+ UTI/WDL"
"4";"NORTH";"04 0746+ UTI/WDL"
"4";"NORTH";"04 0749+ UTI/WDL"
"4";"NORTH";"04 0756 UTI/BUR"
"4";"NORTH";"04 0801 UTI/WDL"
"4";"NORTH";"04 0807+ UTI/WDL"
"4";"NORTH";"04 0811+ UTI/WDL"
"4";"NORTH";"04 0814 UTI/WDL"
"4";"NORTH";"04 0818 UTI/WDL"
"4";"NORTH";"04 0822 UTI/BUR"
"4";"NORTH";"04 0822 UTI/WDL"
"4";"NORTH";"04 0826+ UTI/WDL"
"4";"NORTH";"04 0831+ UTI/BUR"
"4";"NORTH";"04 0835+ UTI/WDL"
"4";"NORTH";"04 0839+ UTI/WDL"
"4";"NORTH";"04 0847+ UTI/BUR"
"4";"NORTH";"04 0851+ UTI/WDL"
"4";"NORTH";"04 0855+ UTI/WDL"
"4";"NORTH";"04 0901 UTI/BUR"
"4";"NORTH";"04 0901 UTI/WDL"
"4";"NORTH";"04 0909 UTI/WDL"
"4";"NORTH";"04 0911 UTI/WDL"
"4";"NORTH";"04 0917+ UTI/WDL"
"4";"NORTH";"04 0924+ UTI/WDL"
"4";"NORTH";"04 0931+ UTI/BUR"
"4";"NORTH";"04 0933+ UTI/WDL"
"4";"NORTH";"04 0939+ UTI/WDL"
"4";"NORTH";"04 0943 UTI/BUR"
"4";"NORTH";"04 0949 UTI/WDL"
"4";"NORTH";"04 0952 UTI/BUR"
"4";"NORTH";"04 0957 UTI/WDL"
"4";"NORTH";"E4 0604+ NLT/WDL"
"4";"SOUTH";"04 0600 WDL/UTI"
"4";"SOUTH";"04 0603 WDL/UTI"
"4";"SOUTH";"04 0609 WDL/UTI"
"4";"SOUTH";"04 0615 WDL/UTI"
"4";"SOUTH";"04 0621 WDL/UTI"
"4";"SOUTH";"04 0627 WDL/UTI"
"4";"SOUTH";"04 0631 WDL/UTI"
"4";"SOUTH";"04 0636 WDL/UTI"
"4";"SOUTH";"04 0641 WDL/UTI"
"4";"SOUTH";"04 0647 WDL/UTI"
"4";"SOUTH";"04 0657 WDL/UTI"
"4";"SOUTH";"04 0659 KGB/UTI"
"4";"SOUTH";"04 0702 WDL/UTI"
"4";"SOUTH";"04 0706+ WDL/UTI"
"4";"SOUTH";"04 0712+ BPK/UTI"
"4";"SOUTH";"04 0713 WDL/BWG"
"4";"SOUTH";"04 0715 WDL/UTI"
"4";"SOUTH";"04 0721+ WDL/UTI"
"4";"SOUTH";"04 0729+ BPK/UTI"
"4";"SOUTH";"04 0729+ WDL/UTI"
"4";"SOUTH";"04 0733+ WDL/UTI"
"4";"SOUTH";"04 0742 BPK/UTI"
"4";"SOUTH";"04 0742 WDL/UTI"
"4";"SOUTH";"04 0746 WDL/UTI"
"4";"SOUTH";"04 0750 WDL/UTI"
"4";"SOUTH";"04 0754 WDL/UTI"
"4";"SOUTH";"04 0759 WDL/UTI"
"4";"SOUTH";"04 0804 WDL/UTI"
"4";"SOUTH";"04 0808 WDL/UTI"
"4";"SOUTH";"04 0813+ WDL/UTI"
"4";"SOUTH";"04 0818+ WDL/UTI"
"4";"SOUTH";"04 0824 WDL/UTI"
"4";"SOUTH";"04 0829 WDL/UTI"
"4";"SOUTH";"04 0834 WDL/UTI"
"4";"SOUTH";"04 0840+ WDL/UTI"
"4";"SOUTH";"04 0847 WDL/UTI"
"4";"SOUTH";"04 0853 WDL/UTI"
"4";"SOUTH";"04 0900 WDL/UTI"
"4";"SOUTH";"04 0903+ WDL/UTI"
"4";"SOUTH";"04 0907+ WDL/UTI"
"4";"SOUTH";"04 0914 WDL/UTI"
"4";"SOUTH";"04 0920 WDL/UTI"
"4";"SOUTH";"04 0923+ WDL/UTI"
"4";"SOUTH";"04 0930+ WDL/UTI"
"4";"SOUTH";"04 0939 WDL/UTI"
"4";"SOUTH";"04 0947 WDL/UTI"
"4";"SOUTH";"04 0955 WDL/UTI"
"Q";"NORTH";"1Q 0601 STL/962"
"Q";"NORTH";"1Q 0610+ STL/962"
"Q";"NORTH";"1Q 0620+ STL/962"
"Q";"NORTH";"1Q 0629 STL/962"
"Q";"NORTH";"1Q 0637 STL/962"
"Q";"NORTH";"1Q 0644+ STL/962"
"Q";"NORTH";"1Q 0652 STL/962"
"Q";"NORTH";"1Q 0659+ STL/962"
"Q";"NORTH";"1Q 0706 STL/962"
"Q";"NORTH";"1Q 0713 STL/962"
"Q";"NORTH";"1Q 0719 STL/962"
"Q";"NORTH";"1Q 0725 STL/962"
"Q";"NORTH";"1Q 0731 STL/962"
"Q";"NORTH";"1Q 0737 STL/962"
"Q";"NORTH";"1Q 0743 STL/962"
"Q";"NORTH";"1Q 0749 STL/962"
"Q";"NORTH";"1Q 0755 STL/962"
"Q";"NORTH";"1Q 0801 STL/962"
"Q";"NORTH";"1Q 0807 STL/962"
"Q";"NORTH";"1Q 0813 STL/962"
"Q";"NORTH";"1Q 0821+ STL/962"
"Q";"NORTH";"1Q 0823+ STL/962"
"Q";"NORTH";"1Q 0829+ STL/962"
"Q";"NORTH";"1Q 0833+ STL/962"
"Q";"NORTH";"1Q 0843+ STL/962"
"Q";"NORTH";"1Q 0853+ STL/962"
"Q";"NORTH";"1Q 0903 STL/962"
"Q";"NORTH";"1Q 0905+ STL/962"
"Q";"NORTH";"1Q 0908+ STL/962"
"Q";"NORTH";"1Q 0913 STL/962"
"Q";"NORTH";"1Q 0917+ STL/962"
"Q";"NORTH";"1Q 0923+ STL/962"
"Q";"NORTH";"1Q 0929+ STL/962"
"Q";"NORTH";"1Q 0939+ STL/962"
"Q";"NORTH";"1Q 0947+ STL/962"
"Q";"NORTH";"1Q 0949+ STL/962"
"Q";"NORTH";"1Q 0955+ STL/962"
"Q";"NORTH";"1Q 0959+ STL/962"
"Q";"NORTH";"EQ 0840 CAN/962"
"Q";"SOUTH";"1Q 0601 962/STL"
"Q";"SOUTH";"1Q 0611+ 962/STL"
"Q";"SOUTH";"1Q 0621+ 962/STL"
"Q";"SOUTH";"1Q 0631+ 962/STL"
"Q";"SOUTH";"1Q 0641+ 962/STL"
"Q";"SOUTH";"1Q 0651+ 962/STL"
"Q";"SOUTH";"1Q 0659+ 962/STL"
"Q";"SOUTH";"1Q 0707+ 962/STL"
"Q";"SOUTH";"1Q 0715+ 962/STL"
"Q";"SOUTH";"1Q 0723+ 962/STL"
"Q";"SOUTH";"1Q 0731+ 962/STL"
"Q";"SOUTH";"1Q 0733+ 962/STL"
"Q";"SOUTH";"1Q 0739+ 962/STL"
"Q";"SOUTH";"1Q 0744 962/STL"
"Q";"SOUTH";"1Q 0747+ 962/STL"
"Q";"SOUTH";"1Q 0754+ 962/STL"
"Q";"SOUTH";"1Q 0801+ 962/STL"
"Q";"SOUTH";"1Q 0808+ 962/STL"
"Q";"SOUTH";"1Q 0815+ 962/STL"
"Q";"SOUTH";"1Q 0821+ 962/STL"
"Q";"SOUTH";"1Q 0827+ 962/STL"
"Q";"SOUTH";"1Q 0833+ 962/STL"
"Q";"SOUTH";"1Q 0837+ 962/STL"
"Q";"SOUTH";"1Q 0841+ 962/STL"
"Q";"SOUTH";"1Q 0849+ 962/STL"
"Q";"SOUTH";"1Q 0855+ 962/STL"
"Q";"SOUTH";"1Q 0902+ 962/STL"
"Q";"SOUTH";"1Q 0909+ 962/STL"
"Q";"SOUTH";"1Q 0917+ 962/STL"
"Q";"SOUTH";"1Q 0924 962/STL"
"Q";"SOUTH";"1Q 0933+ 962/STL"
"Q";"SOUTH";"1Q 0941+ 962/STL"
"Q";"SOUTH";"1Q 0949+ 962/STL"
"Q";"SOUTH";"1Q 0957+ 962/STL"
"Q";"SOUTH";"EQ 0905 962/STL"


Post a New Response

(1461026)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Wed Jan 3 14:38:54 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Wed Jan 3 11:28:22 2018.

Thank you, okay I've downloaded the software. Now you have to register with MTA for an API Key, How do you leave "Company" blank?

Post a New Response

(1461033)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by randyo on Wed Jan 3 15:41:39 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Wed Jan 3 11:02:08 2018.

I can’t recall the individual car types, but at the time I’m referring to I was on the IRT and the only cars in service were either redbirds or R-62s and 62As and with the exception of the Flushing Line which was 100% redbird R-36s with some R-33 singles and a few R-17s to sub for R-33Ss out for GOH, and the 1 and 3 which were 100% R-62A, the rest of the division had a mix of redbirds and either R-62s on the 4 or 62As on the 6.

Post a New Response

(1461131)

view threaded

Re: Morning AWOL Report for 2 Jan 2018 - Revised

Posted by BusRider on Thu Jan 4 10:29:50 2018, in response to Re: Morning AWOL Report for 2 Jan 2018 - Revised, posted by Stephen Bauman on Wed Jan 3 11:39:32 2018.

Thank you for posting.

Post a New Response

(1461134)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Thu Jan 4 10:35:45 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by randyo on Wed Jan 3 15:41:39 2018.

So basically, Car Equipment informed your department of total cars available and to be used as spares. Then, you would take previous schedules and if service did not match, then frequencies were adjusted? Say you had 400 trips on the #2 during the Weekday utilizing 35 trains but due to a shortage you only had 24 available for service. Plus, assuming a 20% spare factor (7 trains).

Post a New Response

(1461135)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Thu Jan 4 10:37:03 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Wed Jan 3 11:28:22 2018.

Were there any special packages I was supposed to install when installing the Postgresql?



Post a New Response

(1461151)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Thu Jan 4 12:43:49 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Thu Jan 4 10:37:03 2018.

The postgresql (and any other software for that matter) depends on the computer and operating system. I'm running Linux, the postgresql is installation included in the distribution. I don't know about other systems. I know, you can get postgresql from postgresql.org. They have packages that can be downloaded for various os's. They also have a tarball that contains the sources. You can compile it for any other system.

Once installed, it has to be initialized. There are detailed instructions on how to initialize it. It depends on your os. There should be a console program called initdb that will initialize the database. You then have to modify 2 configuration files: postgresql.conf and pg_hba.conf to determine how much access each user and/or ip address has. After that you should be able to use a client like either psql or pgAdmin to log in as the super user postgres. Your first SQL should be to set up a role under your usual login name for your pc.

After that, you are in the database business.

Post a New Response

(1461170)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by randyo on Thu Jan 4 13:49:37 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Thu Jan 4 10:35:45 2018.

That would be about right but the difference between what was needed and what was available was not that severe. If, for example the desired level of service might call for 35 trains it might be that there were only 33 available so timetables were generated accordingly.

Post a New Response

(1461301)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Fri Jan 5 18:07:42 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Thu Jan 4 12:43:49 2018.

The site says "You have no access" to the Real-time feed, after I signed up and confirmed my account.

Post a New Response

(1461302)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by ro_jo on Fri Jan 5 19:19:25 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by 7 Local on Tue Jan 2 19:27:42 2018.

I'm also curious why there are scheduled 7X in the N direction during the morning rush?
At first, I figured that when SB 7Xs turned at 34th, they were still counted as 7Xs, but the numbers don't come close to matching up, and that's not how they count the 6/6X. So I'm still confused.



Post a New Response

(1461303)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Fri Jan 5 19:34:28 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Fri Jan 5 18:07:42 2018.

Here's a link to the MTA page that tells how to access the feed.

You enter the key id that the MTA emailed you in place of the part in the url. N.B. the <> brackets are replaced.

You will need a program to download the data - your www client probably won't work or try to display a binary file. You need something that will act like a screen scraper. One possibility is wget, which is available for Linux, and I hear also for windows. Another possibility is to use an equivalent within a programming language library and write a program. The cloud that I was using did not allow executing shell commands like wget, there is an equivalent library for python. So, I had to refresh my python skills.

The downloaded file is an unreadable serialized binary. You will need to download protoc, which google provides. I decided to forego the available protobuf files and do a raw decode. You will now have a text file that you will have to read and work with.

Post a New Response

(1461309)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Fri Jan 5 19:48:37 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by ro_jo on Fri Jan 5 19:19:25 2018.

All I'm doing is reading the data that the MTA provides.

They've made a lot of blunders in implementing the gtfs-rt protocol. One of those blunders was confusing trains (equipment) with trips. This makes it impossible to track a equipment.

From the MTA explanations, they are following the ATS system nomenclature. The MTA wrote the specs for the ATS and it was modeled on what they did with paper, pencil and green eye shades.

Post a New Response

(1461320)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Fri Jan 5 22:22:43 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Fri Jan 5 19:34:28 2018.

Thank you as I am NO computer science wiz. I'll read what you say and attempt over and over until I succeed!

Post a New Response

(1461321)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Fri Jan 5 22:32:58 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Fri Jan 5 19:34:28 2018.

Also, to open SQL, its the Shell not the Application Stack Builder, correct?

Post a New Response

(1461323)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Fri Jan 5 22:39:48 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Fri Jan 5 19:34:28 2018.

Lastly, the protoc is the zip file "protobuf-master.zip" at "https://github.com/google/protobuf"?

Post a New Response

(1461324)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Fri Jan 5 22:54:47 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Fri Jan 5 22:32:58 2018.

I've stayed away from enterprisedb.com. You should be able to get all the information you need to start up from the postgresql.org site. They already have binary packages to download for linux, mac and windows.

N.B. postgresql is a backend server. it communicates with a client via the port 5432 on the internet. However, you can run the server and the client on the same machine. your host is localhost in the setup. the conf files are usually set up to allow only local access. you have to modify them for remote access (which you probably don't want).



Post a New Response

(1461327)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Fri Jan 5 23:04:40 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Fri Jan 5 22:39:48 2018.

what's on the zip file? is there an executable that's appropriate for your machine? if so, that's all you will need.

there are 2 basic modes for protoc that I've used. one creates source code for a library in one of a few programming languages that will decompress the binary into something that's readable. The protobuf files supply names for numbers for some of the data. there's usually a lot of problems with the mta feed and the protobuf files the mta supplies. that's why I opted to do raw decode and supply my own names for the numbers. I can see, where the mta goofed in their feed. at least i can get through the protoc stage.

Post a New Response

(1461328)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Fri Jan 5 23:06:26 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Fri Jan 5 22:22:43 2018.

you're going to learn a lot about programming, databases and other things before you succeed.

Post a New Response

(1461355)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Sat Jan 6 09:58:33 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Fri Jan 5 23:04:40 2018.

As of right now, this is what I have:

-eight (8) gtfs files from the MTA link (assuming those are binary files).

-A zip file called "protobuf-master", that I downloaded from "https://github.com/google/protobuf".

Within the zip file includes: 22 file folders and 26 files. The file formats are File, YML File, Windows Batch File, SH File, Text Document, ISON File, AC File, PY File, Build File, AM File, BZL File, IN File, PODSPEC File, and MD File.

-WGET files from "https://ftp.gnu.org/gnu/wget/", I assume the most recent files based on the date were the ones to download (that being the newest version 19.2, so it includes four (4) files: "wget-1.19.2.tar.gz, wget-1.19.2.tar.gz.sig, wget-1.19.2.tar.lz and wget-1.19.2.tar.lz.sig".

I am honestly clueless at this point, I browsed through the GTFS page on Google regarding Transit and I remember using CodeAcademy back in college with Python but that was unsuccessful.

Post a New Response

(1461359)

view threaded

Scheduling...continued

Posted by BusRider on Sat Jan 6 10:21:32 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by randyo on Thu Jan 4 13:49:37 2018.

When you created a timetable, did you work backwards? For instance, you have 35 trains available and I wanted to schedule the "A" line. Determine or use established running times, evaluate merge points (and add timing for merge points into the running time), based on the running times, mileage of the line, and consider the general inspection routine (say every 5,000 miles) calculate the number of trips one trainset could operate until you reach the 35. Then populate the timetable based on that headway (if it has changed based on the new train amount)?

I also was curious, unlike buses, instead of Layover/Recovery, does trains need a similar but longer buffer between trips to recharge (I'm not referring to crew recovery time)?

Post a New Response

(1461360)

view threaded

Re: Scheduling...continued

Posted by Joe V on Sat Jan 6 10:31:11 2018, in response to Scheduling...continued, posted by BusRider on Sat Jan 6 10:21:32 2018.

Depends on the system. On NJT, for route 605 in the Princeton area, first they decide they're going to put out only 2 buses, then calculate the end-end running time, and create a schedule. That's why it runs 75 minute intervals. Every route is different, which is why clockface schedules are out the window and connections are hit and miss, work only by coincidence. It's an amateur operation, clueless as to how much business they lose by lack of connections.

Post a New Response

(1461364)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Sat Jan 6 11:42:33 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Sat Jan 6 09:58:33 2018.

As of right now, this is what I have:

-eight (8) gtfs files from the MTA link (assuming those are binary files).


If you have downloaded the gtfs-rt files from the MTA, then you don't need wget. It's purpose is to download files.

-A zip file called "protobuf-master", that I downloaded from "https://github.com/google/protobuf".

Within the zip file includes: 22 file folders and 26 files. The file formats are File, YML File, Windows Batch File, SH File, Text Document, ISON File, AC File, PY File, Build File, AM File, BZL File, IN File, PODSPEC File, and MD File.


What you are looking for is an executable file called protec, protec.exe (for windows). This executable should be consistent with your operating system. I assume that sh file stands for a linux shell file and windows batch file stands for a windows executable. These are the likely suspects for a binary you don't have to build.

N.B. the text files might have some hints - there might even be readme files somewhere.


Post a New Response

(1461383)

view threaded

Re: Scheduling...continued

Posted by BusRider on Sat Jan 6 13:58:56 2018, in response to Re: Scheduling...continued, posted by Joe V on Sat Jan 6 10:31:11 2018.

Sounds like a major inconvenience!

Post a New Response

(1461392)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Sat Jan 6 14:39:12 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Sat Jan 6 11:42:33 2018.

What you are looking for is an executable file called protec, protec.exe (for windows). This executable should be consistent with your operating system. I assume that sh file stands for a linux shell file and windows batch file stands for a windows executable. These are the likely suspects for a binary you don't have to build.

N.B. the text files might have some hints - there might even be readme files somewhere.


Okay I found none of that in this zipfile. Though I came across this, on my search in Google, "https://github.com/google/protobuf/releases/tag/v3.5.1", Downloaded some of the links and I found a file that had Application file in it. When I clicked it a command prompt screen appeared but it disappeared instantly.

To be truthful, I'm going in this blind. But, seeing your posted reports, intrigued me to try and learn as I have some analysis ideas of my own, I would like to explore with this data.


Post a New Response

(1461409)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by Stephen Bauman on Sat Jan 6 16:33:00 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by BusRider on Sat Jan 6 14:39:12 2018.

Here's a link to the page you probably need:

https://github.com/google/protobuf.

Note the instructions on this page:

For non-C++ users, the simplest way to install the protocol compiler is to download a pre-built binary from our release page:

https://github.com/google/protobuf/releases

In the downloads section of each release, you can find pre-built binaries in zip packages: protoc-$VERSION-$PLATFORM.zip. It contains the protoc binary as well as a set of standard .proto files distributed along with protobuf.

If you hit that link you will see:

Assets
6.35 MB protobuf-all-3.5.1.tar.gz
8.24 MB protobuf-all-3.5.1.zip
4.07 MB protobuf-cpp-3.5.1.tar.gz
5.04 MB protobuf-cpp-3.5.1.zip
4.39 MB protobuf-csharp-3.5.1.tar.gz
5.51 MB protobuf-csharp-3.5.1.zip
4.52 MB protobuf-java-3.5.1.tar.gz
5.7 MB protobuf-java-3.5.1.zip
4.22 MB protobuf-js-3.5.1.tar.gz
5.28 MB protobuf-js-3.5.1.zip
4.5 MB protobuf-objectivec-3.5.1.tar.gz
5.63 MB protobuf-objectivec-3.5.1.zip
4.4 MB protobuf-php-3.5.1.tar.gz
5.47 MB protobuf-php-3.5.1.zip
4.35 MB protobuf-python-3.5.1.tar.gz
5.42 MB protobuf-python-3.5.1.zip
4.34 MB protobuf-ruby-3.5.1.tar.gz
5.36 MB protobuf-ruby-3.5.1.zip
1.26 MB protoc-3.5.1-linux-aarch_64.zip
1.27 MB protoc-3.5.1-linux-x86_32.zip
1.32 MB protoc-3.5.1-linux-x86_64.zip
1.83 MB protoc-3.5.1-osx-x86_32.zip
1.78 MB protoc-3.5.1-osx-x86_64.zip
1.2 MB protoc-3.5.1-win32.zip



Following their instructions, they have compiled binaries for 32 and 64 bit linux, 32 and 64 bit osx (mac) and 32 bit windows. Download and unzip the appropriate file. If you have 64 bit windows, their advice is to go to an earlier version - there's also a link for that.

Post a New Response

(1461413)

view threaded

Re: Morning AWOL Report for 2 Jan 2018

Posted by BusRider on Sat Jan 6 17:25:28 2018, in response to Re: Morning AWOL Report for 2 Jan 2018, posted by Stephen Bauman on Sat Jan 6 16:33:00 2018.

Yes, that's the page I was on and downloaded the bold to be on the safe side. My system is 64-bit windows, x64 processor.

Post a New Response

[1 2]

 

Page 1 of 2

Next Page >  


[ Return to the Message Index ]