Full Screen toggle does not retain panel layout and size

In MacOS, when I use the "F" key to toggle into Full screen mode, it retains the panel layout, but when toggling back out of full screen all of the panels shrink to a miniature window size. Then toggling back to full screen, the new panel proportions carry over. Ideally, toggling in and out of Full Screen mode should have minimal impact on window/panel layout, but if you set-up a workspace in full screen, then hit F twice the whole layout is lost.
 
This is particularly frustrating since F is next to G, and G is commonly used to toggle from thumbnails to single image view, so F can be hit by mistake easily.
 
Edit: Adding Images for reference.  This is an example of the full screen layout before toggling out:

Then toggled out of Full Screen: