How to prevent additional swipe being required on Buttons on Android when using Talkback and a custom renderer?

Where custom renderers are used for Buttons on Android, with renderers derived from Xamarin.Forms.Platform.Android.AppCompat.ButtonRenderer, users who use Talkback have to do an additional swipe to move the accessibility focus from one Button to another. Does anybody know how to prevent that extra swipe being required (other than getting rid of the custom renderer)?
This can be reproduced by add a custom renderer that derives from Xamarin.Forms.Platform.Android.AppCompat.ButtonRenderer but that does not have any additional code in it.
[Updated below this point in response to Jarvan's first post below. Have to update here due to 1000 character restriction on comments!]
Create two Buttons, as follows:
Button btnTestLabel1 = new Button
{
Text = "Test Button 1"
};
btnTestLabel1.AutomationId = "TestLabelAutomationId";
btnTestLabel1.SetValue(AutomationProperties.HelpTextProperty, "Test label help text");
btnTestLabel1.SetValue(AutomationProperties.IsInAccessibleTreeProperty, true);
btnTestLabel1.SetValue(AutomationProperties.NameProperty, "Test label name");
Button btnTestLabel2 = new Button
{
Text = "Test Button 2"
};
btnTestLabel2.AutomationId = "TestLabelAutomationId";
btnTestLabel2.SetValue(AutomationProperties.HelpTextProperty, "Test label help text");
btnTestLabel2.SetValue(AutomationProperties.IsInAccessibleTreeProperty, true);
btnTestLabel2.SetValue(AutomationProperties.NameProperty, "Test label name");
Add those buttons to a ContentPage.
Add a custom Button renderer:
[assembly: ExportRenderer(typeof(Button), typeof(MyButtonRenderer))]
namespace MyAndroid
{
public sealed class MyButtonRenderer :
Xamarin.Forms.Platform.Android.AppCompat.ButtonRenderer
{
}
}
Build and run the app on an Android physical device. Start Talkback. Tap once on the first Button, Then swipe to the right once. The accessibility focus should move to the second Button. It doesn't. Remove the custom renderer and it does.