Jump to content
The simFlight Network Forums

Delay in record to csv data write


GoldenAero7

Recommended Posts

Greetings. 

I am developing an application that requires real-time data from FS. I have used "record to csv.lua" for reading values of specific parameters required through FSUIPC7. It is stated that "record to csv.lua" writes data into csv 20 times per second, which means the interval between each data would be 50 msec. However, after viewing the data in the csv file, i have noticed that the "msecs" values shows that there is an interval of 0.8~1 second between each data capture. I have inserted the csv file that was produced from a session I had on FS. As seen under the "msecs" header, the values increment by almost a thousand between each row which corresponds to a second. Is this behaviour normal? Is my assumption on the "msecs" values wrong in any way? Any enlightenment is greatly appreciated.

 

 

FSrecord.csv

Edited by GoldenAero7
Link to comment
Share on other sites

There seems to be an issue with the speed of lua scripts when FSUIPC7 is auto-started by MSFS. Can you try manually starting FSUIPC7 - just exit it and restart manually, then try recording again to see if you get a faster rate.

If I run this lua when FSUIPC7 is auto-started, I also see data logged at approx. 800ms intervals, as you do:

Quote

msecs,timeL,timeZ,lat,lon,alt(ft),pitch,bank,hdgT,hdgM,vs,ias,tas,gs,mach
47,10:08:00,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
938,10:08:01,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
1735,10:08:02,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
2531,10:08:02,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
3297,10:08:03,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
4094,10:08:04,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
4891,10:08:05,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
5688,10:08:06,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
6485,10:08:06,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
7266,10:08:07,0808Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002

If I exit FSUIPC7, and restart it manually, I see data logged at roughly 63ms intervals:

Quote

msecs,timeL,timeZ,lat,lon,alt(ft),pitch,bank,hdgT,hdgM,vs,ias,tas,gs,mach
0,10:09:04,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
63,10:09:04,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
125,10:09:04,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
188,10:09:04,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
250,10:09:04,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
313,10:09:04,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
375,10:09:04,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
438,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
500,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
563,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
625,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
688,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
750,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
813,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
875,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
938,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
1000,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
1063,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
1125,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
1188,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
1250,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002
1313,10:09:05,0809Z,42.2421,-8.6240,834.1,-1.00,0.13,191.4,                                                                                        193.0,0,0,0,0,0.002

 You can also speed things up further by reducing the delay in the sleep statement on line 58:
    ipc.sleep(48)

Note that this was reported previously in the following topic, but I have only just realized that this is related to how FSUIPC7 is started: 

 

John

Link to comment
Share on other sites

  • 2 weeks later...

Thank you for the suggestion. I have tried to manually restart FSUIPC but the data is still logged at ~800ms intervals. The issue is still not resolved. I would appreciate it if you could have a thorough look into this issue.

Thanks,

Zamir

Link to comment
Share on other sites

Can you please make sure you are using the latest released version of FSUIPC7, 7.4.11, or even better try the latest beta release, available from:

and show me your FSUIPC7.log, FSUIPC7.ini and csv files.

5 hours ago, GoldenAero7 said:

The issue is still not resolved. I would appreciate it if you could have a thorough look into this issue.

As I said, I only see this here when FSUIPC7 is started by MSFS via the EXE.xml file, and I have no idea why this is. I will look at you files to see if I can see anything, but there is not much I can do. 

What is the load like on your system? What aircraft do you have loaded - if using an airliner, have you tried with a GA aircraft?

John

Link to comment
Share on other sites

I could not attach the files you requested here due to file size constraints. Hence, I have pasted the contents of FSUIPC7.ini and FSrecord.csv as following. However, please advice on how i could share the FSUPIC7.log file as it is tremendously bigger in size. Also, these files are obtained after running the latest beta release.

Quote

FSUIPC7.ini

[Sounds]
Device1=Primary Sound Driver
Device2=Speakers (Realtek(R) Audio)

[General]
UpdatedByVersion=7412c
PMDG737offsets=Auto
UseSystemTime=No
JoystickTimeout=20
DisconnTrimForAP=No
ZeroElevForAPAlt=No
ThrottleSyncAll=No
EnableExtraButtons=Yes
ShowPMcontrols=No
SpoilerIncrement=512
MagicBattery=No
RudderSpikeRemoval=No
ElevatorSpikeRemoval=No
AileronSpikeRemoval=No
ReversedElevatorTrim=No
ClockSync=No
ClockSyncMins=5
ClearWeatherDynamics=No
PauseAfterCrash=No
BrakeReleaseThreshold=75
SaveDataWithFlights=No
ShortAircraftNameOk=Substring
UseProfiles=Yes
WideLuaGlobals=Yes
InvokeFSUIPCOptionsKey=70,12
AxesWrongRange=No
TCASid=Flight
TCASrange=40,3
AxisCalibration=No
DirectAxesToCalibs=No
AxisIntercepts=No
DontResetAxes=No
ThreadAffinityMask=x0
LuaAffinityMask=x0
LogOptionProtect=Yes
AutoConnectToSim=Yes
AutoExitWithSim=Yes
TimeForLuaClosing=2
TrafficStallTime=2
NormalStallTime=2
LuaRerunDelay=66
ComReadLoopTime=10
ComWriteLoopTime=10
ControlsListBuild=999
Window=657,296,1158,396
Console=No
ConsoleWindowTopMost=No
ConsoleWindow=51,51,946,569
DebugLua=Yes
FSVersionUsed="KittyHawk",11.0.282174.999
SimConnectUsed=11.0.62651.3
InitialStallTime=5
DetectToConnectDelayAuto=50
StartUpTuningActive=Yes
StartUpTuningDoneVersion=1

[JoystickCalibration]
RudderBlendLowest=1

[Axes]
PollInterval=10
RangeRepeatRate=10

[LuaFiles]
1=record to csv

[Buttons]
PollInterval=25
ButtonRepeat=20,10

[AutoSave]
Next=1
Interval=60
Files=10
SaveOnGround=No
AutoSaveEnabled=No

[GPSout]
GPSoutEnabled=No

[GPSout2]
GPSoutEnabled=No

[WideServer]
WideFSenabled=Yes

[Auto]
1=Lua record to csv
 

 

Quote

FSrecord.csv

                             
msecs timeL timeZ lat lon alt(ft) pitch bank hdgT hdgM vs ias tas gs mach
46 10:15:30 1415Z 40.7007 -74.0085 79 0.35 4.47 55.6 68.2 1492 1 3 4 0.027
968 10:15:31 1415Z 40.7007 -74.0085 104.8 2.24 7.86 54.6 67.3 1640 2 3 7 0.028
1828 10:15:32 1415Z 40.7008 -74.0085 129.1 1.87 8.1 53.3 66 1696 2 4 10 0.03
2656 10:15:33 1415Z 40.7008 -74.0085 152.6 0.9 4.76 51.6 64.3 1712 2 5 13 0.032
3515 10:15:34 1415Z 40.7009 -74.0085 177.9 -0.23 3.62 49.6 62.3 1715 3 6 14 0.034
4375 10:15:34 1415Z 40.7009 -74.0086 201.9 -1.69 3.3 47.6 60.3 1712 4 7 16 0.035
5218 10:15:35 1415Z 40.701 -74.0086 225.6 -2.31 5.54 45.5 58.1 1696 5 7 17 0.036
6078 10:15:36 1415Z 40.7011 -74.0086 249 -1.7 9.78 43.3 55.9 1643 5 7 19 0.038
6937 10:15:37 1415Z 40.7011 -74.0087 271.3 -1.4 12.38 39.2 51.8 1551 6 8 22 0.04
7796 10:15:38 1415Z 40.7012 -74.0087 289.8 -1.59 16.21 31.7 44.4 1417 7 11 26 0.044
8656 10:15:39 1415Z 40.7013 -74.0088 306.6 -0.01 13.02 17.3 30 1276 8 16 29 0.047
9515 10:15:39 1415Z 40.7014 -74.0089 323.3 -0.27 6.07 352.4 365.1 1217 11 24 31 0.049
10359 10:15:40 1415Z 40.7015 -74.009 342.5 -5.25 3.55 333.1 345.8 1289 15 29 30 0.05
11218 10:15:41 1415Z 40.7016 -74.0091 363.7 -10.72 4.05 329 341.7 1450 18 29 28 0.048
12078 10:15:42 1415Z 40.7017 -74.0093 389.4 -13.88 1.7 326.5 339.1 1630 20 26 25 0.045
12937 10:15:43 1415Z 40.7017 -74.0094 415.2 -14.88 -0.38 324.3 336.9 1771 21 22 21 0.041
13781 10:15:44 1415Z 40.7017 -74.0094 443.8 -13.83 -4.14 321.9 334.6 1856 21 18 17 0.037
14640 10:15:45 1415Z 40.7018 -74.0095 470 -12.03 -6.32 319.9 332.6 1876 20 15 13 0.034
15500 10:15:46 1415Z 40.7018 -74.0096 497.5 -9.46 -7.13 318 330.7 1850 18 11 10 0.03
16359 10:15:46 1415Z 40.7018 -74.0096 520.9 -6.89 -8.31 316.5 329.1 1788 16 9 8 0.027
17218 10:15:47 1415Z 40.7018 -74.0097 545.5 -4.46 -7.19 315.1 327.8 1709 14 7 6 0.025
18062 10:15:48 1415Z 40.7018 -74.0097 568.1 -1.59 -4.7 314 326.7 1627 12 5 6 0.024
18921 10:15:49 1415Z 40.7018 -74.0097 590 1.24 -2.89 313.1 325.8 1545 11 5 6 0.023
19781 10:15:50 1415Z 40.7019 -74.0097 609                  

 

Quote

 What aircraft do you have loaded - if using an airliner, have you tried with a GA aircraft?

The aircraft I have loaded is Guimbal Cabri G2 which, correct me if I'm wrong, is a GA aircraft.

Zamir

Link to comment
Share on other sites

25 minutes ago, GoldenAero7 said:

I could not attach the files you requested here due to file size constraints.

Your upload limit will increase as you post more - it is restricted/rather low for new users. Try compressing/zipping them - they should compress well as they are only text files. Otherwise, you can share them using one of the web transfer services to do this, such as https://filetransfer.io/ or https://wetransfer.com/.

30 minutes ago, GoldenAero7 said:

The aircraft I have loaded is Guimbal Cabri G2 which, correct me if I'm wrong, is a GA aircraft.

I have the G2 so I can check with that aircraft here.

John

Link to comment
Share on other sites

Quote

Try compressing/zipping them - they should compress well as they are only text files.

Zipping the files didn't work as the upload limit was still too small. Instead, I have uploaded the files onto this link

Zamir

Link to comment
Share on other sites

28 minutes ago, GoldenAero7 said:

How about this link?

That link is good,

Your log file shows that FSUIPC7 was auto-started via the EXE.xml file:

Quote

      390 12748 Auto-started via EXE.xml with DetectToConnectDelayAuto=60, InitialStallTime=20

As I said in my post above, there is an issue with lua performance when FSUIPC is started this way. Can you either exit FSUIPC7 once started and restart it manually, or better to re-install and accept the default installation options, which should auto-start via the batch file and not the EXE.xml file.

John

Link to comment
Share on other sites

Quote

Can you either exit FSUIPC7 once started and restart it manually, or better to re-install and accept the default installation options, which should auto-start via the batch file and not the EXE.xml file.

Alright. I will give it a try. 

Zamir

Link to comment
Share on other sites

2 hours ago, John Dowson said:

or better to re-install and accept the default installation options, which should auto-start via the batch file and not the EXE.xml file.

It wasn't obvious where to download the new installer in the post I referenced as it was included in a comment further down the page. I have updated this now to reference the installer in the first post. You can download from here: https://fsuipc.simflight.com/beta/Install_FSUIPC7beta.exe.

John

Link to comment
Share on other sites

Quote

Can you either exit FSUIPC7 once started and restart it manually, or better to re-install and accept the default installation options, which should auto-start via the batch file and not the EXE.xml file. You can download from here: https://fsuipc.simflight.com/beta/Install_FSUIPC7beta.exe.

I have given your suggestion a try but it came to no avail as the delay still exists. I have attached the log files for the session I had on the latest release which was manually started.

Zamir

FSrecord.csv FSUIPC7.ini FSUIPC7.log

Link to comment
Share on other sites

I get a similar rate (i.e. every 800ms or so) when lua plugin logging is enabled:

Quote

msecs,timeL,timeZ,lat,lon,alt(ft),pitch,bank,hdgT,hdgM,vs,ias,tas,gs,mach
46,13:02:44,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000
953,13:02:45,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000
1781,13:02:46,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000
2609,13:02:47,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000
3437,13:02:48,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000
4265,13:02:49,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000
5093,13:02:49,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000
5890,13:02:50,1102Z,42.2422,-8.6240,834.0,0.65,0.20,191.3,                                                                                        193.0,0,0,0,0,0.000

but if I turn off lua plugin logging the rate increases to roughly every 63ms (and faster rates if I reduce the ipc.sleep delay at line 59, which defaults to 48ms):

Quote

msecs,timeL,timeZ,lat,lon,alt(ft),pitch,bank,hdgT,hdgM,vs,ias,tas,gs,mach
0,13:02:19,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
63,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
125,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
188,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
250,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
313,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
375,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
438,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
500,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
563,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
625,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000
688,13:02:20,1102Z,42.2422,-8.6240,834.0,0.64,0.18,191.3,                                                                                        193.0,0,0,0,0,0.000

So, what rate do you see if you turn off the lua plugin logging?

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use. Guidelines Privacy Policy We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.