Here's throwing an idea into the wild. How about using SVG for rendering in the display engine? The attached image shows the rendering as a proof of concept for feasibility. The top window shows the SVG rendering of the buffer shown in the bottom window. Though I'm not sure about the practicality at this point of time. I'd love to hear your thoughts.
display_engine.png