Introduction
Only hours after yesterday's post, I received notification that Flixwagon had been updated. In this version, the application includes new options for video settings. There are four in total*.
- Low quality, EDGE friendly. Low quality mode: suitable for broadcast over slow networks such as EDGE (176x144, 5 fps)
- Smoother (Recommended). Smoother mode: Makes moving objects look even better. Suitable for most filming scenarios. (176x144, 12 fps)
- Sharper. Sharper mode: Adds more details to the the** video image, but less effective in capturing motion. (236x176, 7 fps)
- Still objects (See "Details" below). Still objects mode: Highest resolution. Lowest FPS. Only suitable for broadcasting still objects such as printed text and pictures (300x224, 3 fps)
Methods
Initially, I set out to perform a quality test, just to see if there was a significant difference in the output between the various settings. However, as often occurs with experimentation, I ended up with unexpected results. Accordingly, my tests from this morning became more of an evaluation of the setting descriptions themselves rather than the video output quality. Below are the basic circumstances surrounding my tests.
- Time: All trials took place between 7:58 and 8:45am EST.
- Network: All trials were completed over the AT&T EDGE 2G network. The signal strength was at four bars for the vast majority of the testing. There were a few intermittent spikes where the signal would drop to three bars or rise to five bars.
- Duration: On each trial, I stopped the recording when the timer hit 14 seconds, although some videos still reached the site at 13, 15, or 16 seconds.
- Application Version: 0.4.45
For each trial, I tapped the bobble-head doll to get it moving, and began recording. After 14 seconds, I stopped recording, and started an online stopwatch (http://www.online-stopwatch.com). Once the video had uploaded to 100%, I paused the stopwatch and recorded the time.
Results
| Setting | Trial Number | Upload Time (m:ss) | Video Link*** |
| Low quality | 1 | 2:32 | Watch |
| Low quality | 7 | 1:44 | Watch |
| Smoother | 2 | 3:03 | Watch |
| Smoother | 8 | 2:17 | Watch |
| Sharper | 3 | 2:01 | Watch |
| Sharper | 4 | 4:25**** | Watch |
| Still objects | 5 | 1:38 | Watch |
| Still objects | 6 | 1:39 | Watch |
The two fastest times occurred using the "Still objects" setting. Next came the "Low quality" setting, which had a comparable time to "Still objects" in the second trial, but a longer one in the first. Due to the outlying trial, the data from the "Sharper" setting is inconclusive. "Smoother" had the slowest upload times of all groups.
Conclusions
Upload Performance
The different settings produced surprising results in terms of upload time. Interestingly enough, "Still objects" had the fastest times. While this setting features the highest resolution available, it also employs the lowest frame rate. One might expect "Low quality" to be in the first position, but it was instead a close second, perhaps due to the increased frame rate. Although the "Sharper" data was inconclusive, judging by the normal trial and frame rate, I suspect that this setting would follow "Low quality" as third fastest in the long run. "Smoother" was the slowest, but not by an excessive margin. It also features the highest frame rate. These findings, while not definitive by any means, seem to suggest that frame rate is a vital factor in the time it takes to upload a video via the iPhone and EDGE network.
Another point of interest surrounds the overall application upload performance in comparison to previous versions. Even the outlying trial took only four and a half minutes. In my original use of the application, videos would take at least five minutes, and up to ten or thirty, to upload. This indicates that the technology is steadily improving. It is exciting to see videos uploading in only one to two minutes, even though they were only 14 seconds long. If the performance can continue to increase, perhaps to the point where a video takes as long to upload over the 2G networks as it does to record, users will have a very practical, useful, and powerful application at hand.
Video Quality
After reviewing the videos, I have determined that there is no "best" setting for the iPhone. A large factor in the type of setting that should be used is again, the frame rate. Moving subjects will look much better on the "Smoother" setting than any of the others, thanks to the higher frame rate. The difference that frame rate makes can be seen even in the light nodding demonstrated by the bobble head doll in these trials. On the other hand, the fidelity of video appears to be largely unaffected by the mode that is chosen. To the eye, each setting seems to output roughly an equal picture. Yet, the "Low quality" and "Smoother" options did not handle details quite as well as "Sharper" and "Still objects." All things considered, the situational context should be the primary concern for videographers, rather than the desired output quality.
Error
There were a number of possibilities for error in this experiment. I attempted to control the conditions as best as possible, however the results seem to indicate that there were either external factors affecting upload times (most likely) or that the difference between the video settings is not significant over the 2G network. One uncontrollable factor that I believe may have had an impact on my results is the ability of Flixwagon's servers to receive my videos. The rate of transfer seemed to start out a little slower, increase significantly for trial 3, drop off at trial 4, and then increase again for the remaining attempts. Likewise, only being able to judge by the bars on my phone and not by the exact kb/s means that the EDGE network could have had varying transfer rates between the recordings, even though it remained consistently in the four bar range. Naturally, the number of trials and conditions are the other form of error. This test took place within one hour on a single day and with only two attempts per setting.
To Users
While the difference between 1:44 and 3:03 may be significant from a statistical standpoint, it mostly likely is not in a practical sense. Thus, from a user perspective, upload time is not likely to be a factor that influences which setting one uses. Likewise, there is not a noticeable difference between the video output quality for different settings. I recommend that videographers think first about what they wish to record and choose a setting accordingly. The descriptions give an accurate view of what to expect in the final video (i.e. use "Smoother" for recording motion and "Still objects" for static subjects). It is still worth considering the network connectivity, however. When in a weak 2G signal area, it may be best to use the "Low quality" or "Still objects" setting in spite of subject matter.
Notes
*Descriptions taken directly from the Flixwagon iPhone application v.0.4.45
**A minor typo in the description
***Will open in a new window
****I view this trial as an outlier. There was a 5-10 second delay during the upload, whereby it suffered from "No Network Activity" and subsequently had to reconnect to the video server. Although this delay does not account for the large difference in time, I believe that the servers probably had an overall loss of strength during the trial, which caused a slower upload for this particular video.







