Friday, 4 March 2016

GH1 vs GH4 - generations

well, having compared my GH1 some time back to an OMD E-M5 (here) and compared Out Of Camera JPEG images and then some post processed RAW images from both I came to the conclusion that the cameras were about a par on image quality and that there was little or no compelling reason for a stills photographer to upgrade their GH1 in that direction on the basis of image quality if they are inclined to shoot raw.

Since we just got a new GH4 in our office in the Video Production unit I thought I'd have a look at the two cameras side by side to see what has really changed. Again  this perspective is from that of stills (which such cameras are validly used for).

premise of comparison

I am fundamentally a stills photographer. Further, I know my craft and I don't feel any need for (nor do I actually like working with) bucket loads of automation. I find it distracting and takes my thoughts away from the actual job of making an image. I hate fiddling with multiple settings and normally work in Aperture priority or Program Modes. I shoot in RAW so that I can process afterwards because I've never been fully satisfied with OOC JPEG for everything.

So if that does not sound like you and you are into video then its simple - the feature sets of the GH4 make it streets ahead. Just get it.

So for me I had some questions to answer, and some were already clear in my mind. What was clear?

Specs: I knew that the image sizes of the cameras were 12Megapixel vs 16Megapixel ... that would be clear. All cameras that do in camera image correction (or later in software such as LightRoom if you wish it) absorb a number of the pixels in that correction. So while the uncorrected width of the GH1 is 4016 pixels (not 4000) the the same is true for GH4 which goes from an uncorrected RAW pixels of 4624 down to an OOC JPG of 4608.

However its also mysterious to people how to interpret pixels, they fail to grasp that its actually a square ratio and that to understand the comparison we should take the square root.
For the GH1 the square root of 12Mp is 3.46 and for the GH4 at 16Mp that's 4. Suddenly the numbers don't look so importantly different.

Lets put that number set into a visual. So if you print to the maximum DPI of the cameras then this is the difference in print size you'll gain...
Didn't blow my sox off either ...

But I also knew that the GH1 had something that the GH4 had foregone, and that is the multi format sensor (discussed here).  Meaning that for anyone who shoots stills in 16:9 that the GH1 will have a bit more up its RAW sleeve with 4368 pixels wide. This reduces the gap between the two sensors in some situations. You can see clearly that the 4:3 records a greater height than anything and the 16:9 records a greater width. Looking in particular at the 16:9 compared to the 4:3 we see this:
So the 16:9 is recording 352 more pixels (and importantly) by actually capturing a wider area of the image circle cast by the lens.

Lastly I do not believe there has been any real (meaning x2 or better) improvement in sensors since 2010. Sure, pixel pitch has come down, and sure read times are faster ... but to a stills photographer its really only

  • the actual shutter you get 
  • for the actual aperture you've set
  • at the actual ISO you've set, 
  • and the signal to noise

that's the big ticket items to me.

The Nitty Gritty

All shots were taken with the same lens (Panasonic 25mm f1.7) at f4 to minimise any focus issues in the area. I then took shots with the camera on Av and just bumped up the ISO from base to max in 1 EV steps.

Ok, so speaking of ISO, lets look at the ISO differences, the GH1 was "under rated" at birth to have a ISO100 that was effectively measured at 137 anyway, giving you an advantage which continues to be almost one stop throughout the range. ... This is made clear in the DxO measurement chart (see here)(and my testing showed shutter speeds which were consistent with this point)



so you can see that when ISO 400 is selected  on both cameras the GH1 gives 591 while the GH4 gives shutter speeds that would match ISO 227; which is about a full stop difference (a little more actually) in favor of the GH1.

The result of this (should it need to be made more obvious) is that when thinking of image noise you need to compare the GH1 to the setting above it on the GH4 to be equal.

Yes, that means at 1600 ISO the GH1 is essentially giving you sensitivity (and thus shutter speeds for a given aperture) of the GH4 set to 3200. Meaning that the GH4 matches the normal King Wang user who looks only at numbers and not at results.

Bit Range

Recently I looked at the Sony A7 using a RAW file analysis method (see here) that allowed me to see exactly where the data started recording (on which digital quanta {see quantisation if confused}) and where it ended. From this I can see clearly which camera has what range of data.

NOTE: it has been observed by a reader that I may be mistaken in this approach and that the true issue is the voltage output range not the quantised data range as a reflection of white and black points. That may be true (or may not be if Panasonic did not specifically recalibrate their sensors to their ADC), but not necessarily. If you are seeing more in the dark than me, or more in the highlights than me then great ... but to me I see about the same. I'd need to use a Stouffer Step Wedge to be sure of the exact ranges (which I didn't think of). 

So lets have a look at that. First here is my test shot setup.



I have (in the red circles) everything from clipping to dark and murky  ... specifically to test the range of each. The red square is the point of focus.

Shots taken on a tripod and processed variously with my tool of choice DCRAW ... why dcraw? Well for a start its an equaliser, it shows things without "fix ups" in software (which can be done to both if you like) to allow me to see the real RAW data not the make up department and touch up department: not soRAW.

So the GH1 consistently started recording pixels at quanta 16, while the GH4 started recording at quanta 142 ... both started recording at the same time in all channels (which is nicer if you ask me and nicer than the A7). Clearly the GH4 is ignoring some 'low level' quanta which would probably be to avoid "floor noise".

Then where does it end? Well the GH1 decided to put the last of the clipping in at quanta 3990 while the GH4 ran out to 4097. Which is interesting as this gives the GH1 an actual recorded data range of 3974 and the GH4 slightly less at 3953 levels.

So:

  • Start = 16 vs 142 (earlier in the range than GH1)
  • End = 3990 vs 4097 (the GH4 records longer into the range ... but)
  • range = 3974 vs 3953 (actually less!)

So it is interesting that the DxO ratings suggest that the GH4 has a greater bit depth (23.2 bits vs 21.6 bits). I don't see how this works as bit depth is the range.



Which isn't what I find ... So to me the GH1 has actually a slight lead on the amount of bit depth available over that of the GH4. This suggests to me that DxO is only looking at the data end points or that they think there is more noise in the GH1 low end. I'm not sure that this the case here, and I don't know how they measure it (but I do know what they say is how they calculate it). This matches the findings that I had with the A7 in my earlier post (or they are doing something more cunning).


So what does the Noise look like

Well they were all good to the 1600 setting on the GH1. So this is ISO 1600 on the GH1 and 3200 on the GH4 , given that these settings mean that the actual ISO for each was 2154 and 1860 respectively. Yes, that's right the GH4 when set to 3200 actually yeilds a wee bit over 1600 but the GH1 yeilds almost 3200. This is reflected in the shutter speeds which were 160 and 200th respectively.



since these are both 100% pixel views you will see that the above chart showing relative print sizes is about bang on.

So, Noise looks startingly similar (as one would expect if there has indeed been no progress in sensors as I expected).

Next lets look at the maximum ISO of the GH1 which is 3200 ... according to DxO that works out to be a measured ISO of 4176 for the GH1 and with the GH4 set to 6400 gives a measured ISO of 3835, again lower despite being higher.


This time we see that the GH1 is falling apart more than the GH4 is in two ways:

  • a colour shift is occurring (I did dcraw with -w to use the cameras white balance settings on all images)
  • and noise is starting to become striated and follow patterns, while the GH4 is still looking "organic" in its noise.


So myself I'm going to say that I'd be happy with the GH4 at that higher ISO much more so than the GH1 ... which fits what I've always found that one ISO stop below MAX ISO is the limit effective limit.

So, lets look at what the GH4 gave up beyond the GH1 limit of 3200


well its dirtier that's for sure ... is it usable to you? Sure ain't what I'd want to use.

Lastly lets step outside of the box and compare OOC JPEG from the GH4 @ ISO 6400 with the GH1 @ ISO 3200 made with RawTherapee (a modern but free editor)

This is a central portion of the image at 100%

So GH4 ...



which looks clean and sweet ... but shows (to me) strong smudging which is the hallmark of more aggressive noise reduction.

GH1...


with only primitive noise reduction.

Less clean for sure, but you know, I can read those book ends better (meaning its sharper)

afterthought

after writing this I came across the NIK suite for free (thanks Google) and thought I'd try applying some noise reduction to the TIFF from the GH4 (and nothing to the GH1) file. So this is the result of that


To me the GH1 is a usable result while the GH4 is still rough. Sure you gain a shutter speed increase from to 320th up to 1600th of a sec (two stops as lens was f4 in both) but I would wonder (now that I think about it) would the GH1 have been more like that if I'd just pushed it 2 stops by increasing the shutter speed and compensating in post?

dunno ... something to try next...

conclusion


So there you have it, some interesting questions raised (well interesting to me) about how DxO measurements should be understood (clearly its not that simple) and some results that support that for a stills photographer that the GH1 is still as good a camera as the day it was released, maybe even better than almost anything around today (as mentioned it was hardly less than the E-M5 I pitted it against). Considering you can get the GH1 for under $200 its got to be a consideration.

The GH1 also brings some interesting features to the table for those who may wish to shoot other than 4/3 ratio and still makes great images. That your wide lens becomes a little wider in 16:9 than any other camera has to count for something (especially given that it comes with no penalty).

It supports my views that the major benefits of the current cameras are:
  • that you can buy them new (needed for some businesses)
  • have better in camera features

If you're a budget conscious shooter and your focus is on the produced images then a used GH1 is a great buy, you get:

  • flip screen (which people now are discovering how handy it is)
  • great EVF, among the biggest even today
  • great image quality, equal to almost anything in m43 today
  • lighter and smaller
  • great battery life
  • access to cheap batteries

probably its the "sleeper cell" killer camera of the m43 world ... still ...

2 comments:

Øyvin Eikeland said...

Hi,
I do not quite understand how to measure ISO accurately or how DXO does it. Anyway, I think you should at least compare shots taken with the same shutter speed and aperture for both cameras. Then you should just crank up the ISO until you have a proper exposure on both cameras given the amount of light available. I would still be interested in your findings but I don´t think this comparison is fair (?)

obakesan said...

Oyvin

I didn't want to get too deep into technicals with this post. However I think that its reasonable to say that for most people they just set ISO200 (or whatever) and do not think about it more deeply. The important point (which you can actually get from this articles mention of shutter speeds) is that at a full stop lower the shutter speed is actually almost the same.

Setting the shutter speeds to be the same (instead of relying on the system to set the shutter) would then be problematic in accurately determining how far "under" or "over" each shot was ... that would blow out the length of this article.

:-)