[fix] Reconnection logic and Backoff policy doesn't work correctly

[crossoverJie]

Fixes #1187

Modifications

• Move backoff.go to the backoff directory (because there are circular dependencies, they are not moved to the pulsar directory.)
• Create a new method for BackOffPolicy interface IsMaxBackoffReached(delayReconnectTime, totalDelayReconnectTime time.Duration) bool

This is a breaking change that modifies the package name and interface name.

Package: internal->backoff
Interface name: BackoffPolicy-> Policy

Verifying this change

• Make sure that the change passes the CI checks.

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

• Dependencies (does it add or upgrade a dependency): (no)
• The public API: (yes)
• The schema: (no)
• The default values of configurations: (no)
• The wire protocol: (no)

Documentation

• Does this pull request introduce a new feature? (no)
• If yes, how is the feature documented? (GoDocs)
• If a feature is not applicable for documentation, explain why?
• If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

[crossoverJie]

@RobertIndie PTAL

[RobertIndie]

I'm concerned that such breaking changes could significantly impact users. Users would have to implement the new methods introduced by the backoff policy, even if they haven't encountered this issue. Perhaps we could consider including this change in the 1.0 version.

I have initiated a discussion of the Go client 1.0.0: https://lists.apache.org/thread/h022q6nrk23tz2k0qpxjf6j8m1o4qsrt

[crossoverJie]

Perhaps we could consider including this change in the 1.0 version.

Yes, I agree with you.

[nodece]

Any updates?

[crossoverJie]

@nodece The code conflicts have been resolved, but this PR involves changes to the public API. Do you recommend releasing it in version v0.13.0?

[nodece]

This is a breaking change that modifies the package name and interface name.

A breaking change that we add new method to the Backoff interface, not change package name.

In the user project, the user cannot import the internal package of the pulsar library, this is a limitation, please check https://go.dev/doc/modules/layout

[crossoverJie]

Package: internal->backoff
Interface name: BackoffPolicy-> Policy

Update:

BackoffPolicy internal.BackoffPolicy -> BackOffPolicyFunc func() backoff.Policy:

1. Because the Policy is concurrently called in the consumer, it has been modified to obtain a policy object each time using the backoffPolicyFunc function.

pulsar-client-go/pulsar/consumer_partition.go

Lines 1709 to 1712 in 1152cfc

	} else if pc.options.backoffPolicy == nil {
	delayReconnectTime = defaultBackoff.Next()
	} else {
	delayReconnectTime = pc.options.backoffPolicy.Next()

pulsar-client-go/pulsar/consumer_partition.go

Lines 607 to 609 in 1152cfc

	nextDelay := backoff.Next()
	if nextDelay > remainTime {
	nextDelay = remainTime

2. A new Reset function has been added to the Policy interface, which will be called after a successful reconnection. If a user's custom Policy requires the reuse of the same object, the data can be reset within this Reset function.

[RobertIndie]

Please help resolve the conflicts