Brief:
The plane geometry is extremely expensive to render and exponentially slows the scene down. This is likely due to how large it is and how far it is rendered. Aside from the 10,000 unit render distance limit, many other optimizations can be implemented to drastically reduce the plane rendering time.