lightning: meet "[PD:client:ErrClientTSOStreamClosed]encountered TSO stream being closed unexpectedly" during checksum

[D3Hunter]

Enhancement

in lightning 7.1.0 we met this error during get TSO before checksum for some table, but for other table it success. seems a retryable error, maybe we should add a retry to it

[2023/07/11 09:22:31.869 +00:00] [ERROR] [checksum_helper.go:83] ["remote checksum failed"] [table=t] [takeTime=54.710221ms] [error="fetch tso from pd failed: [PD:client:ErrClientTSOStreamClosed]encountered TSO stream being closed unexpectedly"]

[lance6716]

Oh I should pick #44478 + #44856 to release version 😂

[D3Hunter]

it's another error, pd.IsLeaderChange return false explicitly on it

[lance6716]

ErrClientTSOStreamClosed

But the log says it's ErrClientTSOStreamClosed, and pd.IsLeaderChange will return true for it?

[D3Hunter]

you're right, i see it wrong😅

[lance6716]

No I mean I didn't pick #44478 + #44856 to release version 😂 If this is needed I can start cherry-pick

[D3Hunter]

yes, let's cp those 2.

[D3Hunter]

duplicate with #44263