Running a 3 filter sequence of 30 captures per filter - 30 had been captured - filter change and focus on 2nd just completed with 1 capture  successful - MF marked as pending - mount begins flip process and appears to have completed  - starts align and crashes after first capture.  Note the worrying flip failure message followed by flip completed - how can this be? (marked in bold)
All activity in logs stops at the Q warning at the botton - KSTARS is now dead but INDI is still running  (when restarted at 7 am KSTARS want an instance of INDI was running)
There are no other logs or indicators....hopefully something can be deduced from this!

2021-08-23T00:15:06.809 EDT DEBG ][     org.kde.kstars.ekos.guide] - Multistar: findTopStars 1 "Roi(470,777 32x32)"
[2021-08-23T00:15:07.136 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Guide State "Aborted"
[2021-08-23T00:15:07.137 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Capture State "Meridian Flip"
[2021-08-23T00:15:07.137 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Mount State changed to 2
[2021-08-23T00:15:07.145 EDT INFO ][           org.kde.kstars.indi] - LX200 OnStep :  "[INFO] Slewing to RA: 20:49:36 - DEC: 31:47:27 "
[2021-08-23T00:15:07.146 EDT DEBG ][   org.kde.kstars.ekos.capture] - setMeridianFlipStage:  "MF_FLIPPING"
[2021-08-23T00:15:07.290 EDT DEBG ][     org.kde.kstars.ekos.guide] - "Multistar: findTopStars returning: 0 stars, 0.48s"
[2021-08-23T00:15:07.291 EDT DEBG ][     org.kde.kstars.ekos.guide] - Capturing frame...
[2021-08-23T00:15:07.351 EDT INFO ][           org.kde.kstars.indi] - LX200 OnStep :  "[ERROR] Cannot guide while slewing or parking in progress. Stop first. "
[2021-08-23T00:15:07.492 EDT INFO ][           org.kde.kstars.indi] - LX200 OnStep :  "[INFO] Mount is unparked. "
[2021-08-23T00:15:08.513 EDT DEBG ][     org.kde.kstars.ekos.mount] - Mount status changed from  "Slewing"  to  "Tracking"
[2021-08-23T00:15:08.513 EDT DEBG ][     org.kde.kstars.ekos.mount] - Slew finished, MFStatus  "FLIP_RUNNING"
[2021-08-23T00:15:08.543 EDT WARN ][     org.kde.kstars.ekos.mount] - Meridian flip failed, pier side not changed
[2021-08-23T00:15:08.543 EDT INFO ][     org.kde.kstars.ekos.mount] - "meridian flip failed, retrying in 4 minutes"
[2021-08-23T00:15:08.545 EDT DEBG ][     org.kde.kstars.ekos.mount] - Setting meridian flip status to  "FLIP_COMPLETED"
[2021-08-23T00:15:08.545 EDT DEBG ][     org.kde.kstars.ekos.mount] - meridianFlipStatusChanged  "FLIP_COMPLETED"
[2021-08-23T00:15:08.546 EDT INFO ][     org.kde.kstars.ekos.mount] - "Meridian flip completed."
[2021-08-23T00:15:08.547 EDT DEBG ][   org.kde.kstars.ekos.capture] - meridianFlipStatusChanged:  "FLIP_COMPLETED"
[2021-08-23T00:15:08.547 EDT DEBG ][   org.kde.kstars.ekos.capture] - setMeridianFlipStage:  "MF_COMPLETED"
[2021-08-23T00:15:08.548 EDT DEBG ][     org.kde.kstars.ekos.guide] - Reset non guiding dithering position
[2021-08-23T00:15:08.548 EDT INFO ][   org.kde.kstars.ekos.capture] - "Telescope completed the meridian flip."
[2021-08-23T00:15:08.580 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Mount State changed to 3
[2021-08-23T00:15:08.580 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Capture State "Idle"
[2021-08-23T00:15:08.794 EDT INFO ][   org.kde.kstars.ekos.capture] - "Performing post flip re-alignment..."
[2021-08-23T00:15:08.798 EDT DEBG ][   org.kde.kstars.ekos.capture] - setMeridianFlipStage:  "MF_ALIGNING"
[2021-08-23T00:15:08.806 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Capture State "Aligning"
[2021-08-23T00:15:10.043 EDT DEBG ][     org.kde.kstars.ekos.guide] - Received guide frame.
[2021-08-23T00:15:10.087 EDT DEBG ][     org.kde.kstars.ekos.mount] - Setting meridian flip status to  "FLIP_NONE"
[2021-08-23T00:15:10.088 EDT DEBG ][     org.kde.kstars.ekos.mount] - meridianFlipStatusChanged  "FLIP_NONE"
[2021-08-23T00:15:10.088 EDT DEBG ][   org.kde.kstars.ekos.capture] - meridianFlipStatusChanged:  "FLIP_NONE"
[2021-08-23T00:15:11.918 EDT DEBG ][   org.kde.kstars.ekos.capture] - Focus State changed from "Idle" to "Changing Filter"
[2021-08-23T00:15:11.918 EDT INFO ][     org.kde.kstars.ekos.align] - "Changing filter to OIII..."
[2021-08-23T00:15:11.922 EDT INFO ][           org.kde.kstars.indi] - ASI EFW :  "[INFO] Setting current filter to slot 6 "
[2021-08-23T00:15:13.890 EDT DEBG ][   org.kde.kstars.ekos.capture] - Focus State changed from "Changing Filter" to "Idle"
[2021-08-23T00:15:13.891 EDT DEBG ][   org.kde.kstars.ekos.capture] - Align State changed from "Complete" to "In Progress"
[2021-08-23T00:15:13.939 EDT INFO ][     org.kde.kstars.ekos.align] - "Capturing image..."
[2021-08-23T00:15:13.968 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Align State "In Progress"
[2021-08-23T00:15:20.210 EDT INFO ][           org.kde.kstars.indi] - QHY CCD QHY183M-ec51fb4 :  "[INFO] Exposure done, downloading image... "
[2021-08-23T00:15:25.339 EDT INFO ][     org.kde.kstars.ekos.align] - "Image received."
[2021-08-23T00:15:25.350 EDT INFO ][     org.kde.kstars.ekos.align] - "Automatically downsampling the image by 3"
[2021-08-23T00:15:25.746 EDT INFO ][     org.kde.kstars.ekos.align] - "Evaluating Installed RAM for inParallel Option.  Total Size of Index files: 31.7906 GB, Installed RAM: 7.66278 GB, Free RAM: 0.260838 GB"
[2021-08-23T00:15:25.749 EDT INFO ][     org.kde.kstars.ekos.align] - "Not enough RAM is available on this system for loading the index files you have in parallel"
[2021-08-23T00:15:25.751 EDT INFO ][     org.kde.kstars.ekos.align] - "Disabling the inParallel option."
[2021-08-23T00:15:25.753 EDT INFO ][     org.kde.kstars.ekos.align] - "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++"
[2021-08-23T00:15:25.755 EDT INFO ][     org.kde.kstars.ekos.align] - "Starting Internal StellarSolver Sextractor with the 4-SmallScaleSolving profile . . ."
[2021-08-23T00:15:26.113 EDT INFO ][     org.kde.kstars.ekos.align] - "Stars Found before Filtering: 22"
[2021-08-23T00:15:26.115 EDT INFO ][     org.kde.kstars.ekos.align] - "Removing the stars with a/b ratios greater than 1.5"
[2021-08-23T00:15:26.117 EDT INFO ][     org.kde.kstars.ekos.align] - "Keeping just the 50 brightest stars"
[2021-08-23T00:15:26.119 EDT INFO ][     org.kde.kstars.ekos.align] - "Stars Found after Filtering: 22"
[2021-08-23T00:15:26.122 EDT INFO ][     org.kde.kstars.ekos.align] - "Starting 4 threads to solve on multiple scales"
[2021-08-23T00:15:26.124 EDT INFO ][     org.kde.kstars.ekos.align] - "Solver # 1, Low 0.1, High 0.71875 arcminwidth"
[2021-08-23T00:15:26.126 EDT INFO ][     org.kde.kstars.ekos.align] - "Solver # 2, Low 0.71875, High 2.575 arcminwidth"
[2021-08-23T00:15:26.128 EDT INFO ][     org.kde.kstars.ekos.align] - "Solver # 3, Low 2.575, High 5.66875 arcminwidth"
[2021-08-23T00:15:26.130 EDT INFO ][     org.kde.kstars.ekos.align] - "Solver # 4, Low 5.66875, High 10 arcminwidth"
[2021-08-23T00:15:26.360 EDT DEBG ][ org.kde.kstars.ekos.scheduler] - Align State "In Progress"
[2021-08-23T00:15:27.979 EDT INFO ][     org.kde.kstars.ekos.align] - "Scale range: 0.71875 to 2.575 degrees wide"
[2021-08-23T00:15:27.983 EDT INFO ][     org.kde.kstars.ekos.align] - "Image width: 5544 pixels, Downsampled Image width: 1848 pixels; arcsec per pixel range: 1.40016 to 5.01623"
[2021-08-23T00:15:27.985 EDT INFO ][     org.kde.kstars.ekos.align] - "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++"
[2021-08-23T00:15:27.987 EDT INFO ][     org.kde.kstars.ekos.align] - "Starting Internal StellarSolver Astrometry.net based Engine with the 4-SmallScaleSolving profile. . ."
[2021-08-23T00:15:28.227 EDT INFO ][     org.kde.kstars.ekos.align] - "Scale range: 2.575 to 5.66875 degrees wide"
[2021-08-23T00:15:28.230 EDT INFO ][     org.kde.kstars.ekos.align] - "Image width: 5544 pixels, Downsampled Image width: 1848 pixels; arcsec per pixel range: 5.01623 to 11.043"
[2021-08-23T00:15:28.232 EDT INFO ][     org.kde.kstars.ekos.align] - "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++"
[2021-08-23T00:15:28.234 EDT INFO ][     org.kde.kstars.ekos.align] - "Starting Internal StellarSolver Astrometry.net based Engine with the 4-SmallScaleSolving profile. . ."
[2021-08-23T00:15:28.237 EDT INFO ][     org.kde.kstars.ekos.align] - "Scale range: 0.1 to 0.71875 degrees wide"
[2021-08-23T00:15:28.240 EDT INFO ][     org.kde.kstars.ekos.align] - "Image width: 5544 pixels, Downsampled Image width: 1848 pixels; arcsec per pixel range: 0.194805 to 1.40016"
[2021-08-23T00:15:28.242 EDT INFO ][     org.kde.kstars.ekos.align] - "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++"
[2021-08-23T00:15:28.244 EDT INFO ][     org.kde.kstars.ekos.align] - "Starting Internal StellarSolver Astrometry.net based Engine with the 4-SmallScaleSolving profile. . ."
[2021-08-23T00:15:28.247 EDT INFO ][     org.kde.kstars.ekos.align] - "Scale range: 5.66875 to 10 degrees wide"
[2021-08-23T00:15:28.249 EDT INFO ][     org.kde.kstars.ekos.align] - "Image width: 5544 pixels, Downsampled Image width: 1848 pixels; arcsec per pixel range: 11.043 to 19.4805"
[2021-08-23T00:15:28.252 EDT INFO ][     org.kde.kstars.ekos.align] - "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++"
[2021-08-23T00:15:28.254 EDT INFO ][     org.kde.kstars.ekos.align] - "Starting Internal StellarSolver Astrometry.net based Engine with the 4-SmallScaleSolving profile. . ."
[2021-08-23T00:15:28.913 EDT WARN ][                       default] - QObject::~QObject: Timers cannot be stopped from another thread
 

FYI - KSTARS 3.5.4 Stable/ INDI 1.9.1 Stable

I started looking at the ekos->mount code and I find a problem that is based on state elsewhere

What is listed below is NOT possible - this would be a really fast mount to slew east to west in 1 second!!!!


2021-08-23T00:15:07.145 EDT INFO ][ org.kde.kstars.indi] - LX200 OnStep : "[INFO] Slewing to RA: 20:49:36 - DEC: 31:47:27 "
[2021-08-23T00:15:07.146 EDT DEBG ][ org.kde.kstars.ekos.capture] - setMeridianFlipStage: "MF_FLIPPING"
[2021-08-23T00:15:07.290 EDT DEBG ][ org.kde.kstars.ekos.guide] - "Multistar: findTopStars returning: 0 stars, 0.48s"
[2021-08-23T00:15:07.291 EDT DEBG ][ org.kde.kstars.ekos.guide] - Capturing frame...
[2021-08-23T00:15:07.351 EDT INFO ][ org.kde.kstars.indi] - LX200 OnStep : "[ERROR] Cannot guide while slewing or parking in progress. Stop first. "
[2021-08-23T00:15:07.492 EDT INFO ][ org.kde.kstars.indi] - LX200 OnStep : "[INFO] Mount is unparked. "

Right here - state is FLIP Running but the peirside has not been yet set to reflect reality (east facing west) as there is no way the mount could not be reporting that status
I suspect that this set up an inconsistent state that somehow lead to the KSTARS crash - since there are timers set to re-flip in this code as a result of the improper state...I know there was work done to get PARK/UNPARK and other mount states in LX200_OnStep - I suspect that is the root cause here - if the set state is not a reality (perhaps reacting to the return of an async call vs a blocking sync call that ACTUALLY has real state) this cascades to a set of incompatible states and actions - and thus a crash - THOUGHTS?

[2021-08-23T00:15:08.513 EDT DEBG ][ org.kde.kstars.ekos.mount] - Mount status changed from "Slewing" to "Tracking"
[2021-08-23T00:15:08.513 EDT DEBG ][ org.kde.kstars.ekos.mount] - Slew finished, MFStatus "FLIP_RUNNING"
[2021-08-23T00:15:08.543 EDT WARN ][ org.kde.kstars.ekos.mount] - Meridian flip failed, pier side not changed
[2021-08-23T00:15:08.543 EDT INFO ][ org.kde.kstars.ekos.mount] - "meridian flip failed, retrying in 4 minutes"
[2021-08-23T00:15:08.545 EDT DEBG ][ org.kde.kstars.ekos.mount] - Setting meridian flip status to "FLIP_COMPLETED"
[2021-08-23T00:15:08.545 EDT DEBG ][ org.kde.kstars.ekos.mount] - meridianFlipStatusChanged "FLIP_COMPLETED"
[2021-08-23T00:15:08.546 EDT INFO ][ org.kde.kstars.ekos.mount] - "Meridian flip completed."
[2021-08-23T00:15:08.547 EDT DEBG ][ org.kde.kstars.ekos.capture] - meridianFlipStatusChanged: "FLIP_COMPLETED"
[2021-08-23T00:15:08.547 EDT DEBG ][ org.kde.kstars.ekos.capture] - setMeridianFlipStage: "MF_COMPLETED"

Flip Test....

Set up with scope point east - Pier on WEST at target RA: 13:33:26 - DEC: 25:23:24

Very close to 16:30:30 pm the FLIP is initiated and by at latest (while watching screens)  16:30:38 (almost immediate) the Mount screen in EKO show Flip Complete
Camera view of the mount shows it is ONLY just starting - the physical flip ends about 16:32:30
I then parked the mount after a short wait

Logs attached but this is really not right - Flip complete  should occur after the mount has successfully slewed to the coordinates - I also attach the INDI driver logs and have marked the last slew with "FLIP -" so you can find it.  What exactly is the MOUNT code looking for from the driver to determine a flip is actually complete?  If state of the mount is not accurate, this could trigger any number of problemsFlip Test....

Set up with scope point east - Pier on WEST at target RA: 13:33:26 - DEC: 25:23:24

Very close to 16:30:30 pm the FLIP is initiated and by at latest (while watching screens)  16:30:38 (almost immediate) the Mount screen in EKO show Flip Complete
Camera view of the mount shows it is ONLY just starting - the physical flip ends about 16:32:30
I then parked the mount after a short wait

Logs attached but this is really not right - Flip complete  should occur after the mount has successfully slewed to the coordinates - I also attach the INDI driver logs and have marked the last slew with "FLIP -" so you can find it.  What exactly is the MOUNT code looking for from the driver to determine a flip is actually complete?  If state of the mount is not accurate, this could trigger any number of problems


[2021-08-23T16:30:34.611 EDT DEBG ][     org.kde.kstars.ekos.mount] - Mount status changed from  "Slewing"  to  "Tracking"
[2021-08-23T16:30:34.611 EDT DEBG ][     org.kde.kstars.ekos.mount] - Slew finished, MFStatus  "FLIP_RUNNING"
[2021-08-23T16:30:34.619 EDT WARN ][     org.kde.kstars.ekos.mount] - Meridian flip failed, pier side not changed
[2021-08-23T16:30:34.619 EDT INFO ][     org.kde.kstars.ekos.mount] - "meridian flip failed, retrying in 4 minutes"
[2021-08-23T16:30:34.621 EDT DEBG ][     org.kde.kstars.ekos.mount] - Setting meridian flip status to  "FLIP_COMPLETED"
[2021-08-23T16:30:34.621 EDT DEBG ][     org.kde.kstars.ekos.mount] - meridianFlipStatusChanged  "FLIP_COMPLETED"
[2021-08-23T16:30:34.621 EDT INFO ][     org.kde.kstars.ekos.mount] - "Meridian flip completed."
[2021-08-23T16:30:34.622 EDT DEBG ][   org.kde.kstars.ekos.capture] - meridianFlipStatusChanged:  "FLIP_COMPLETED"
[2021-08-23T16:30:34.623 EDT DEBG ][   org.kde.kstars.ekos.capture] - setMeridianFlipStage:  "MF_COMPLETED"
[2021-08-23T16:30:34.624 EDT DEBG ][     org.kde.kstars.ekos.guide] - Reset non guiding dithering position
[2021-08-23T16:30:34.624 EDT INFO ][   org.kde.kstars.ekos.capture] - "Telescope completed the meridian flip."
[2021-08-23T16:30:34.626 EDT DEBG ][   org.kde.kstars.ekos.capture] - setMeridianFlipStage:  "MF_NONE"





 

Another test run  - no crash this time BUT this overly quick FLIP_COMPLETE cause problems - in this case you can see the flip started and was complete in a matter of seconds and the ALIGN starts while the mount is moving!!!!! - so it fails with 3 attempts - I am now pointing at some unknown patch of sky and guiding/capture resume - this is a big problem as it make flip/align completely useless - see the image attached - I turned off logs for this run to reduce load and I never crashed 

I don't have logs but I've noticed MF hadn't been working. It would flip and align but the sequence would abort and then one time, Ekos crashed. I had been playing around with different meridian flip degrees on the mount and Ekos. I went back to zero degrees on Ekos and 5 degrees on the mount last night and MF performed perfectly with no crash or aborted sequence. I have no idea if this has anything to do with the problem but it was the only thing I changed so I have a suspicion it had something do to with it. Wish I had logs of when it crashed but I do have this...

 

The bug is in here - or at least this is the problem happens - ISD:Telescope::MOUNT_TRACKING is not accurate and should not be in this state while a slew is on going - this state change happens a second or so after the slew is requested (and takes close to 2 minutes to finish) - this code will work IF the state is correct - I NEED TO KNOW where ISD::Telescope is getting its state - INDI driver or other code?

if (m_Status != currentStatus)
        {
            qCDebug(KSTARS_EKOS_MOUNT) << "Mount status changed from " << currentTelescope->getStatusString(m_Status)
                                       << " to " << currentTelescope->getStatusString(currentStatus);
            // If we just finished a slew, let's update initialHA and the current target's position
            if (currentStatus == ISD::Telescope::MOUNT_TRACKING && m_Status == ISD::Telescope::MOUNT_SLEWING)
            {
                if (m_MFStatus == FLIP_NONE)
                {
                    flipDelayHrs = 0;
                }
                setInitialHA((sgn == '-' ? -1 : 1) * ha.Hours());
                delete currentTargetPosition;
                currentTargetPosition = new SkyPoint(telescopeCoord.ra(), telescopeCoord.dec());
                qCDebug(KSTARS_EKOS_MOUNT) << "Slew finished, MFStatus " << meridianFlipStatusString(m_MFStatus);
            }

            m_Status = currentStatus;

exactly what I have