Out of the Loop

I have surgery very soon & will be out of the loop for a while.

cheers

Rob

October update

I posted an update on my activities in the Biff Diaries. I'm mainly working on 3D projects for relaxation at the moment. I'll return to scenery dabbling in coming weeks/months ;)

In the meantime there are some nice pics of CFS3 scenery work by others, being posted around the web.

http://offaerodrome.com/OFFweb/gallery.htm

and

http://www.sim-outhouse.com/sohforums/showthread.php?t=52790
http://www.sim-outhouse.com/sohforums/showthread.php?t=51783

cheers

Rob

Change of activity

I have eased up on scenery creation for a few weeks, mainly given radiotherapy & its effects. I have also switched over to mainly focusing on aircraft modeling for a few weeks. I will be switching between activities until I recover next year. I'm in a wee bit of pain at the moment.

I still intend to work on my scenery with new trees & textures. As for trees it's a matter of motivating myself to take a few photographs of trees (I'm surrounded by them) for the textures & I will composite ground textures from a variety of free sources including hand painting some of my own. For copyright reasons it is best NOT to use and mod FSX textures. It would be illegal to distribute such to others as not every CFS3 user owns FSX.

I will also be continuing work on my landclass system and integrating the above into it.

The problem with lines on water looks as if it will be difficult to get rid of. The CFS3 terrain SDK tools and CFS3 scenery engine was not designed with SRTM & SWBD data in mind. The terrain features a LOD system, unfortunately the water system doesn't. The lo-res terrain lods intersecting with the high-res SWBD data causes the water polys to bend where they intersect with with the terrain causing lines to appear. This can be seen occasionally in the CFS3 PTO Solomons theatre. I think the only way they can be reduced (not eliminated) is to use hand drawn coast line vectors, a massive task. If one takes a look at the coast lines in FSX they are all fairly lo-res coastlines.

I did start to create a terrain map for the Philippines, however creating the coastline vectors is a massive task.

In the meantime I hope to post a bit more on aircraft creation in the Biff Diaries in the next couple of weeks.

Rob

CFS3 Marianas

I can now reveal the primary area that I am working on (there are two more) - The Mariana Islands. To date I have the terrain mesh, ocean polygons, & shorelines working. There are minor issues such as airfield facilities distorting terrain mesh near coastlines - just a matter of playing around with airfield altitude in the global layer. As I mentioned in the previous post I have found that hand editing or hand creating coastlines works best.

Next I move on to landclass & scenery objects, that will take me a couple of weeks. Presently the terrain only has one woodland landclass just to get the terrain & ocean into CFS3.

Here are a couple of pics - one of a rather bare Apra harbour and the other two of Pagan Island, which Japan held until late in the war and used to raid Saipan.



Rob

Update Sunday

My CFS3 terrain experiments still continue. I managed to create a group of islands at an image stride & LOD of 64 meters which gave me a buzz this morning. What amazed me was that frame rates were barely affected. The verdict is out as to whether mesh at this resolution is worthwhile. The 64m LOD took all night to compile and takes about 600mb space. A 128m LOD (at 64m stride) only takes a couple of hours to compile and is about 140mb in size.

As to coastline data, I find that hand digitising of coastlines worked best in my current theatre. Of course such is a bit unweildy in areas with hundreds of islands. The problem with the CFS3 terrain engine & tools is that if a shoreline lines up with terrain at an altitude of more than a couple of meters it produces a sliver like spike radiating from the shoreline across the ocean, like a mini tsunami if you get down close and have a look at it. I notice a few in the Solomons theatre as well as my own experiments.

Anyway on to tidy up my coastlines - there are still a few glitches. The next step will be landclass & scenery, it's all very generic at this stage. This will keep me going maybe a couple of weeks.

Partial Success

I now have a couple of CFS3 theatres partially up & running. At this stage I have only completed the basics to get a map area operational.

Currently I have to commute daily to hospital for radiotherapy, which can take up to five hours out of my day if I have lunch & do a bit of shopping. Transport from my home on the island, to the hospital only takes just over an hour, but the return trip can take 3 hours given timetable gaps in the public transport system. Thus my experiments in terrain creation are somewhat punctuated. I also hope to resume aircraft creation once I am sure I have the main issues in terrain/scenery creation under control. All this is for relaxation LOL.

I have experimented with mixed results. So far I have yet to see any benefit using the CFS3 SDK with hires mesh, though I have more experiments to carry out this week The tiff2msh tool is where things currently fall down as to resolution. I also experienced interesting results with the landclass system which I will fully explore, once I have a nice terrain mesh working.

Also problems with water occur around some of the coastlines causing spikes in the water polys. I am trying to determine whether it is a DEM problem or a problem with some of the SWBD vector data, or whether it is a CFS3 terrain SDK issue or a Global Mapper issue.

I am being a bit circumspect in writing this. I'd like to disclose a bit more, especially some of my explorations as I go along. However with rivalry situations that exist from time to time in various CFS & FS communities I'll keep quiet until I have something to show. I am doing this for relaxation and don't want to be stampeded into competitive situations, which I can see happening.

The other person creating terrains & theatres for CFS3, Ed Wilson, is quietly getting on with his creations just like me, and I have no problems with that and I admire his achievements. After all MAW did inspire me somewhat to experiment with terrain/scenery creation. There are others however, who are prone to creating competitive situations.

One thing I will say though, is that those who liked what I acheived with the CFS3 & FSX Bristol Fighter, can look forward to the same approach in the world of scenery.

However one thing at a time.

cheers

Rob

Update

Following on my last post it appears that I am not the only person working on a Solomons theatre for CFS3 as witness the current news on the Korean Skies page.

In many ways that is good news and I am generally pleased. I don't object to anyone else making terrain for the Solomons or elsewhere. There are heaps of areas I want to create & experiment with and I could have possibly chosen an other area to start with. Anyway I wish Ed well with it.

I have learned a great deal in the last week. The CFS3 SDK tools to convert DEM files to mesh appear to work ok. They even allow the creation of rectangular as opposed to square maps. Unfortunately this is not the case with tool that converts landclass maps to lcf files. It only accepts square maps. Why the rest of the SDK allows for rectangular maps and the landclass tool does not is beyond me... you should have heard me cursing.

I am currently working on water polygons derived from SWBD data. Unfortunately the data contains shapes for many of the islands instead of empty space. I have to convert many small islands to holes in the water by hand....painstaking & I still don't know how the CFS3 water tools will cope with such hi-resolution data......more cussing on the way perhaps? LOL

Anyway back to square one. I will still persevere with the Solomons area as my learning & test area given that I have come so far and carried out much research. I will at least get it into the sim. It will be interesting to see how it compares to the Korean Skies version. Whether I will ever release it..... who knows? I have a great many theatres large & small in many parts of the world from 1914 to 1960's that I would like to attempt. Of course given the contrary way the world operates MS might surprise us all and announce a new CFS.... that would be a long time coming if they did... plenty of time to create for CFS3 ;)

cheers

Rob

Ready to start Solomon Islands theatre

This week I am ready to start moving things into CFS3. My main goal is to get things working using as much of the original CFS3 installation as possible. Later on I can experiment with higher resolution data. However the CFS3 scenery system is difficult enough as it is without trying to improve things from the outset.

The region I am working on is centered at S7.5 , E152.5 and is planned to cover a similar area to CFS3 Europe.

I have been obtaining the appropriate data and checking it out and assembling in my primary GIS application Global Mapper. The CFS3 terrain SDK is certainly making sense now. However I still have to check out all the SDK tools. There's much work in all this & I don't want to overdo things. I also had a nasty flu virus last week which delayed matters. Hopefully I am on the mend now. Radiotherapy begins this week so I'll have less time for creative endeavours.

The data is split into 3 main types -

• topological DEM data - to produce terrain mesh.
  
• vector data - for coastlines, waterbodies, roads & rivers.
• land coverage data - for the landclass system.

The landclass side of things is still WIP at the moment. I want to take a look at the existing CFS3 landclass system & textures before moving ahead with mine. I also have to find a way to convert from USGS data to CFS3 data & line it up on the map. I will add a few new landclass types to CFS3s existing types, but not too many as that will entail a lot of additional work. I will be refering to period maps too, as land use & coverage in the Solomons area differs today from that of the 1940's http://www.lib.utexas.edu/maps/historical/pacific_islands_1943_1945.html Much of the landclass info will be hand edited in a paint program.

As to DEM data, I had originally intended to use the most recent available 3 arc second data. As this is 10 times higher resolution than the data used for CFS3, I am not sure that the CFS3 engine could cope with it over a region as large as the CFS3 European theatre. One has a number of choices : -

• use that data and then use the numbers as in CFS3 & SDK examples. This will leave any resampling downwards to the CFS3 tools. The results of such would not be known. A lot of work just to experiment.
• use SRTM30 data. This is 1km data similar to the resolution used in CFS3. However this data is more recent and accurate than the data used in CFS3.
• use the 3 arc second data & down sample the DEM data in Global Mapper. This is what I have decided on as I will be using the most recent data available.

I intend to further experiment with hi resolution data later and would love to do this also with textures, however for now, using the above approach I will be able to create a theatre the same size as the CFS3 Europe map, using the same figures in the xml files and SDK tool examples.

Vector data was a big chore last week, especially coastline data. Rivers & roads are fairly easy. For this exercise I am using vmap0 data, available from NGA via their rasterroam site. It is easy to extract this data using Global Mapper (the Swiss Knife of GIS applications.). Water body vector data is easy too. I am using SWBD data derived from SRTM data. It is good resolution, though perhaps stepped along the coast lines. I'll have to see how it looks or whether it is noticeable in the theatre.

Even though we have this data we still need vectors for the coastline, this is where the ordeal began (along with the flu), involving many hours of trial and error. I found the vmap0 & NOAA coastline data to be too lo-res & didn't line up with some of the smaller islands. The SWBD data is in area format. The coastline data has to be in lines. Global mapper's convert area to lines function caused some of the smaller islands to disappear, probably due to flaws in the data and we are still left with the problem of deleting the lines comprising the tile borders, which also deletes parts of the coastline in Global Mapper. I needed to find some other way of editing the vector data and extracting and converting to line shape data. The solution - export the vector data to dxf format & import & edit in 3DS Max (this may work too in gmax, though I haven't tried). This was somewhat unwieldy, time consuming and involved much trial & error. Eventually I got there, imported the edited DXF into Global Mapper and then re-exported as a line vector shapefile, now ready for the CFS3 sdk tools. The SDK shoreline tool is reputedly finicky & again much experimentation will be required to find the correct resolution.

A few links

DEM data is obtainable from a number of sources :-

• http://seamless.usgs.gov/ This is not the most recent data, however one can select a region for download from a seamless map intereface.
• http://srtm.csi.cgiar.org/ This is the most recent 3 arc second SRTM data available. The site also provides a link to a Google Earth interface where one can zoom in to download links. http://www.ambiotek.com/topoview (requires GE on your computer). This is the data that I used.
  
• ftp://e0srp01u.ecs.nasa.gov/srtm/version2/SRTM30 - global DEM data at 1km resolution.
• ftp://e0srp01u.ecs.nasa.gov/srtm/version2/SRTM3 - SRTM 3arc second if you know the tiles you want to download.

Other data sources :-

• http://geoengine.nga.mil/ NGA's raster roam site - both dem & vector data including vmap0 vector data
• http://www.ngdc.noaa.gov/mgg/shorelines/shorelines.html - National Geophysical Data Center (NGDC) - coastline data.
• ftp://e0srp01u.ecs.nasa.gov/srtm/version2/SWBD/ - SWBD water body data derived from SRTM data.
• http://landcover.usgs.gov/glcc/index.php - Global Landcover data.
• http://www-gvm.jrc.it/glc2000/ - CGLC2000 - EU global land cover data.
• http://glcf.umiacs.umd.edu/data/landcover/ - GLCF - AVHRR Global Landcover Classification.

Hopefully I'll have a rudimentry theatre up and running in the next 10 days or so.

Rob

Initial research

Much of this week has been involved in aircraft modeling. The rest of the week has been devoted to research.

I have been focusing on the Solomons Islands area as the initial area of interest (for CFS3). Initially I am considering using SRTM 3 arc second DEM data (i.e. 90 metres between grid co-ordinates.) I think CFS3 Europe used the old gtopo30 or dted0 data for its data (30arc seconds), which is at 1km resolution, thus SRTM 3arc data is 10 times the resolution. Until I actually attempt to create the theatre I don't know how the CFS3 engine will handle it. Given the large areas of sea in that locale it may work. Failing that, SRTM30 data will work.
I just want to add that there is even higher resolution terrain data available, SRTM 1 arc second (30 metres). Presently this is only publicly available for the USA and a few other countries. However there is free publicly available 30M data for the Hawaiian Islands. Maybe someone will create a Pearl Harbour theatre at this resolution?

As I mentioned above, much of the week has involved research. This has involved finding as many images as possible of that area, both present and past; researching the WW2 history of that region, indeed the South West Pacific region; and also aircraft used during ww2 in the Solomons. Yep I hope to model a couple of aircraft for the Pacific theatre. I have ordered a book on the Nakajima A6M2-N Rufe and will probably start that soon. Another aircraft has yet to be decided. This afternoon I have been researching the ground cover of the islands which was largely rainforest interspersed with copra plantations.

Creating a new theatre such as this will involve much work, not only terrain, but texture tiles too and re-working of the landclass system. So the theatre will take a bit of time.

The CFS3 terrain SDK is starting to make a little more sense to me now and hopefully I will decide on the initial test area in the next couple of days and start processing.

I still intend to post some links on various resources from history to GIS ... so keep watching (all two of you...if that - LOL).

cheers

Rob

Terrain Creation for CFS3: Starting off & Why

After primarily focusing my simulation related efforts on FS2004 & FSX for 15 months, returning to CFS3 feels a bit strange. I only recently installed CFS3 to allow installation of OFF Phase 2 & MAW. From the scenery perspective both of these add-ons offer considerable improvement over stock CFS3.

I must say after flying FSX for over a year both beta & release, the first thing one notices when flying CFS3 is the low resolution of the terrain textures. Actually I'm finding them not as bad as I first thought. The ground textures in CFS3 are slightly better than the stock terrain textures in FS2004, however FS2004 wins over CFS3 with building autogen. FS2004 terrain textures are more aliased, jaggy, than CFS3. FSX's 1024x1024 terrain tiles offer a considerably sharper experience than the other two MS sims. Aircraft in CFS3 however do look nice & sharp and are well shaded, and while CSF3's material system is not as fully featured as FSX, offers more options than FS2004.

Anyway my first step is to gain an understanding of CSF3's texture rendering methods, which employs a layered technique modulated by xml mos files. This will involve systematic analysis of all stock ground texture files in CFS3 and pouring through the CFS3 Terrain SDK documents.

I'm also trying to decide on an area to test first. Presently I am looking at the Solomon Islands area and have carried out a few days research on the geography, WW2 history of that region, and looking at the available GIS data. I have also had a quick gander at Spain. I may end up doing something totally different, perhaps a small area.

I have already set up a second CFS3 installation to form the basis of my test region. Today I will set up an additional installation basically to experiment with the guts of CFS3. I know a few others have done likewise however I believe in finding out things for myself and also greatly enjoy experimentation.

Why CFS3?

Why am I focusing on CFS3? A number of reasons - There is no indication of another combat flight simulator from Microsoft and given their current projects i.e. DX10 for FSX, Acceleration Pack for FSX and Train Simulator, Aces will be occupied for quite some time. MS/Aces will also have to start developing FS11 soon too, given that it takes a couple of years to produce a version of FS. There are some other interesting things happening at Aces too, as witness advertised jobs.... Montauk, but no sign of a combat simulator. Given their current projects, even if MS decided on a CFS, we wouldn't see one until 2010 or 2011 (unless of course, there is an ultra top secret one on the way). That's a long time to go without.

Aviation history & also military aviation are consuming passions for me, and FSX while being very nice graphicly just does not cut it from the historical perspective. Even if MS do not add combat to Flight Simulator, they have to, at least consider adding the fourth dimension i.e. time & history to the simulator, the ability to have autogen & scenery appear by date, similar to CFS3's xdp files for sim objects.

Thus CFS3, despite its shortcomings offers the only possibly venue, for me at least, as a sand box to explore & satisfy my interest in military aviation history, in the short term. I do hope to create terrain & scenery for FSX at a later date too... especially my local area. My aircraft creation activities will continue too. Now that much of the learning curve for FSX is behind me I can spend more time on scenery creation & CFS3.

I am also inspired by especially by MAW and also OFF.

I expect progress in the coming months to be haphazard given health matters. So don't expect anything too soon.

Some resources -

• CFS3 Terrain SDK
• Martin Wright's tutorial on the scenery SDK. Also CFS3 SceneDB and his multi CFS3 utility.
• Some useful material on the Korean Skies site (on the Maintenance page).

I'll a post progress report later in the week & hopefully some links on GIS resources.

cheers

Rob

An Introduction.

Hi - this blog will focus on my experiments in the world of scenery & terrain creation for Microsoft Combat Flight Simulator 3.0 and Flight Simulator X. I also hope to post on my experiments in the world of GIS.

The intention is to suppliment & compliment my existing flight sim & 3D creation blogs, The Biff Diaries and The Wing Fell Off.

I find the world of GIS & its myrad of data formats & information systems somwhat bewildering & confusing for the beginner. I have dabbled with terrain creation on the past using software such as VistaPro on both the Windows & Amiga platforms. However most of that is at least a decade in the past. Things have become much more sophisticated in the interim. Likewise with scenery/terrain creation for MS simulators - especially CFS3. Terrain creation for CFS3 is very much a 'Black Art' and to date, only one person that I know of, has created new maps & theatres for CFS3.

Anyway my voyage of discovery in these black arts of terrain creation, GIS & scenery design has begun. Hopefully it will bear fruit. ;)

Rob