Hello,
We designed a custom board with nrf9160 (modem firmware v1.3.1) that runs an asset tracker type application.
The application uses both, LTE and GNSS:
- logs sensor data at a defined rate to onboard storage
- turns on GNSS every 15min to get a location (60s timeout)
- connects to the cell tower every 15 min exchanges information with a server and disconnects (if no GNSS fix was recorded over the past 15min, then the cell tower information is used to obtain multicell location)
We are running into the following issues:
- 4 out of 5 times, after exactly 24 hours the modem stops responding. AT commands are timing out and it appears that the application gets hung up when trying to disconnect from the network.
- Occasionally, ~8seconds after disconnecting from the network the system resets without any error message.
I use the following two commands to connect and disconnect the LTE network:
- lte_lc_func_mode_set(LTE_LC_FUNC_MODE_ACTIVATE_LTE);
-
lte_lc_func_mode_set(LTE_LC_FUNC_MODE_DEACTIVATE_LTE);
I attached a modem trace for the 24h lockup (sorry for the file size, its 24h and 15min long).
Here is a condensed version of the application log around the 24 hour mark:
// Connecting to LTE network
[24:00:03.420,288] <dbg> lte_lc.at_handler: +CEREG notification: +CEREG: 2,"2BEE","0341AC0A",7
[24:00:03.429,626] <dbg> lte_lc_helpers.parse_cereg: Network registration status: 2
[24:00:03.437,683] <dbg> lte_lc_helpers.parse_cereg: LTE mode: 7
[24:00:03.445,861] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:03.469,360] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:03.490,234] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:03.499,328] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:03.508,911] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:03.516,143] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:03.524,658] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:03.533,325] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:03.542,022] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:03.550,720] <inf> multicell: LTE cell changed: Cell ID: 54635530, Tracking area: 11246
[24:00:03.559,661] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:03.566,894] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:03.575,378] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:03.584,075] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:03.592,742] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:03.601,440] <inf> multicell: Active LTE mode changed: LTE-M
[24:00:03.608,062] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:03.993,347] <dbg> lte_lc.at_handler: +CSCON notification
[24:00:04.002,075] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:04.013,916] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:04.027,618] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:04.047,058] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:04.068,176] <inf> multicell: RRC mode: Connected
[24:00:04.075,469] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:05.492,523] <dbg> lte_lc.at_handler: +CEREG notification: +CEREG: 5,"2BEE","0341AC0A",7,,,"11100000","11100000"
[24:00:05.506,958] <dbg> lte_lc_helpers.parse_cereg: Network registration status: 5
[24:00:05.517,669] <dbg> lte_lc_helpers.parse_cereg: LTE mode: 7
[24:00:05.525,512] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:05.536,010] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:05.546,051] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:05.556,427] <inf> network: Network registration status: Connected - roaming
[24:00:05.565,917] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:05.576,263] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:05.594,085] <dbg> lte_lc_helpers.parse_psm: TAU: 7200 sec, active time: -1 sec
[24:00:05.604,675] <dbg> lte_lc.lte_lc_psm_get: TAU: 7200 sec, active time: -1 sec
// Connecting to our server
[24:00:17.355,346] <err> network: connect() failed, err: 116
// Get GEO location
[24:00:17.403,930] <inf> multicell: Start of cell measurements
[24:00:40.085,998] <dbg> lte_lc.at_handler: +CSCON notification
[24:00:40.092,376] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:40.100,830] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:40.109,527] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:40.118,225] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:40.126,892] <inf> multicell: RRC mode: Idle
[24:00:40.132,110] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:40.710,845] <dbg> lte_lc.at_handler: %NCELLMEAS notification
[24:00:40.717,468] <dbg> lte_lc.at_handler: Neighbor cell count: 1
[24:00:40.724,700] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:40.733,154] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:40.741,821] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:40.750,518] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:40.759,216] <inf> multicell: Neighbor cell measurements received
[24:00:40.766,235] <inf> multicell: Neighbor cells found: 1
[24:00:40.772,247] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:40.787,750] <inf> multicell: Current cell:
[24:00:40.792,846] <inf> multicell: MCC: 302
[24:00:40.797,607] <inf> multicell: MNC: 610
[24:00:40.802,398] <inf> multicell: Cell ID: 54635530
[24:00:40.807,952] <inf> multicell: TAC: 11246
[24:00:40.812,896] <inf> multicell: EARFCN: 5145
[24:00:40.818,023] <inf> multicell: Timing advance: 65535
[24:00:40.823,944] <inf> multicell: Measurement time: 86437548
[24:00:40.830,291] <inf> multicell: Physical cell ID: 300
[24:00:40.836,181] <inf> multicell: RSRP: 55
[24:00:40.840,972] <inf> multicell: RSRQ: 13
[24:00:40.845,733] <inf> multicell: Neighbor cell 1
[24:00:40.851,043] <inf> multicell: EARFCN: 5145
[24:00:40.856,170] <inf> multicell: Time difference: 0
[24:00:40.861,816] <inf> multicell: Physical cell ID: 302
[24:00:40.867,736] <inf> multicell: RSRP: 47
[24:00:40.872,497] <inf> multicell: RSRQ: -3
[24:00:40.877,288] <inf> multicell: Sending location request for HERE ...
[24:00:41.034,851] <dbg> lte_lc.at_handler: +CSCON notification
[24:00:41.043,426] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:00:41.054,077] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:00:41.068,572] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:00:41.082,275] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:00:41.098,815] <inf> multicell: RRC mode: Connected
[24:00:41.105,621] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
[24:00:51.948,822] <err> rest_client: Failed to connect socket, error: 116
[24:00:51.959,991] <err> rest_client: rest_client_do_api_call() failed, err -111
[24:00:51.975,555] <err> multicell_location_here: Error from rest client lib, err: -111
[24:00:51.986,511] <err> multicell: Failed to acquire location, error: -111
// Another attempt to connect to our server
[24:01:02.809,417] <err> network: connect() failed, err: 116
// Disconnect
[24:01:25.733,093] <dbg> lte_lc.at_handler: +CSCON notification
[24:01:25.739,501] <dbg> lte_lc_helpers.event_handler_list_dispatch: Dispatching events:
[24:01:25.747,955] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0003231D
[24:01:25.756,652] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x0001530D
[24:01:25.765,319] <dbg> lte_lc_helpers.event_handler_list_dispatch: - handler=0x00018491
[24:01:25.774,017] <inf> multicell: RRC mode: Idle
[24:01:25.779,235] <dbg> lte_lc_helpers.event_handler_list_dispatch: Done
I'm still trying to record a modem trace for the occasional random reset.
Any help is much appreciated.
Thanks, Alex
