Tuesday, January 29, 2013

Ten years of cumulative precipitation

Ten years of cumulative precipitation

January 28, 2013 to Mapping by Nathan Yau
We've all seen rain maps for a sliver of time. Screw that. I want to see the total amount of rainfall over a ten-year period. Bill Wheaton did just that in the video above, showing cumulative rainfall between 1960 and 1970. The cool part is that you see mountains appear, but they're not actually mapped.  Source on FlowingData
The hillshaded terrain (the growing hills and mountains) is based on the rainfall data, not on actual physical topography. In other words, hills and mountains are formed by the rainfall distribution itself and grow as the accumulated precipitation grows. High mountains and sharp edges occur where the distribution of precipitation varies substantially across short distances. Wide, broad plains and low hills are formed when the distribution of rainfall is relatively even across the landscape.
See also Wheaton's video that shows four years of rain straight up.
Is there more recent data? It could be an interesting complement to the drought maps we saw a few months ago. [Thanks, Bill]

How To Run the SWMM 5 Console from the SWMM 5 GUI

How To Run the SWMM 5 Console from the SWMM 5 GUI

Use the SWMM 5 tools, define the program as the DOS engine or SWMM5.EXE (1), run the tool (2) and see the dos output in the command window of Windows 7 or Windows XP.  It should also be possible to call Matlab and have Matlab call the SWMM 5 program using the SWMM 5 interface.


Saturday, January 26, 2013

InfoSWMM Import and Export from SWMM

Outlets in SWMM 5 can have reverse flow

Outlets in SWMM 5 can have reverse flow

Outlets in SWMM 5 can have reverse flow (1) if the downstream head is greater than the upstream head (2), a flap gate (3) will prevent the flow reversal (4).  An outlet can have both positive and negative flow as long as you do not prevent it by having a flap gate.


Thursday, January 17, 2013

Stopping Tolerance in InfoSWMM, H2OMAP SWMM and SWMM5 Internal Units

Stopping Tolerance in InfoSWMM, H2OMAP SWMM and SWMM5 Internal Units

InfoSWMM, H2OMAP SWMM and SWMM 5 share the same underlying dynamic engine code but one small difference is that InfoSWMM and H2OMAP SWMM allows the user to select the node stopping tolerance instead of always using the default SWMM 5 stopping tolerance of 0.0005  feet.  SWMM 5 uses internal units of feet and shows the output in meters if you are using SI units, as does InfoSWMM and H2OMAP SWMM.  The following table shows how the stopping tolerance translates to inches and millimeters in the engine of a US and SI model.   The smaller the tolerance the larger the number of iterations used during the simulation but using a very small tolerance does not always mean a better simulation.  If possible, for example, with pumps it is better to use a small time step and a medium level tolerance – for example 1 millimeter is a good starting  value, but maybe 2 or 3 millimeters may help if you have a continuity error at a pump node. 
The nodes are considered converged if the depths between successive iterations is less than the stop tolerance of the program (the default stop tolerance is less than the stopping tolerance (Figure 1)

Stopping Tolerance
Inches
Millimeters
0.1000000
1.2000000
30.4800000
0.0500000
0.6000000
15.2400000
0.0100000
0.1200000
3.0480000
0.0050000
0.0600000
1.5240000
0.0001000
0.0012000
0.0304800
0.0005000
0.0060000
0.1524000
0.0000100
0.0001200
0.0030480
0.0000500
0.0006000
0.0152400
0.0000010
0.0000120
0.0003048
0.0000050
0.0000600
0.0015240
0.0000001
0.0000012
0.0000305

Figure 1  If the node depths between successive iterations are less than the stopping tolerance then the node is considered to be converged.

Importing a Link Shapefile into InfoSWMM via GIS Gateway

Importing a Link Shapefile into InfoSWMM via GIS Gateway

Here is how you map the shapefile pipe fields to the InfoSWMM data fields.  One note, you had two diameter fields (feet and inches) and the feet column was mostly zero so I used the inch column.  Here are the four steps and mapping you need to import all of the data from your shapefile.  You will have to use blockedit and convert the diameter from inches to feet in the DB link table (Step 5 – note there are still three missing pipe diameters).

Step 1.  Use the GIS Gateway command and set up the import of the file name, and ID field

Step 2. Set up the mapping between the Shapefile fields and InfoSWMM.  We used link offset and the pipe diameter in inches.

Step 3. Load the mapped shapefile

Step 4.  The imported data from your shapefile into the DB table of InfoSWMM

Step 5  Convert to feet from inches

Thursday, January 10, 2013

Climate-proofing cities

Here's just one example, from Singapore:
Singapore's Marina Barrage.RnD.de.PortraitsSingapore's Marina Barrage.
The Marina Barrage and Reservoir, which opened in 2008, is at the heart of Singapore's two-billion-dollar campaign to improve drainage infrastructure, reduce the size of flood-prone areas, and enhance the quality of city life. It has nine operable crest gates, a series of enormous pumps, and a ten-thousand-hectare catchment area that is roughly one-seventh the size of the country. The system not only protects low-lying urban neighborhoods from flooding during heavy rains; it also eliminates the tidal influence of the surrounding seawater, creating a rainfed supply of freshwater that currently meets ten percent of Singapore's demand. More over, by stabilizing water levels in the Marina basin the barriers have produced better conditions for water sports. The Marina's public areas, which include a sculpture garden, a water-play space, a green roof with dramatic skyline vistas, and the Sustainable Singapore Gallery, bolster the city's tourist economy as well.
That's a brilliant way to address two climate impacts -- large precipitation events and rising sea levels -- at once. Singapore has also elevated all access points to its underground subway a least a meter above high-water flood levels. It's also building desalination plants and systems to reuse waste water. It's also burying its power lines.
Engineers at the Dutch firm Arcadis recently proposed a large new sea barrier for north of New York City's Verrazano-Narrows Bridge. The price tag: $6.5 billion. And that's just one small piece of the puzzle. All this stuff is prudent, but it's expensive.

Tuesday, January 1, 2013

How to Compile SWMM 5 in Visual Studio 2010 Express

How to Compile SWMM 5 in Visual Studio 2010 Express

Download the newest SWMM 5 code(Figure 1) from http://www.epa.gov/nrmrl/wswrd/wq/models/swmm/#Downloads and then make a new directory on your computer. We will call it c:\newSWMM5Code with a subdirectory C:\newSWMMCode\VC2005_DLL  in which the attached vcxproj file is placed.  The source code from the EPA should be placed on C:\newSWMMCode.  You can then open up the file swmm5_ms.vcxproj and make a new SWMM 5 DLL model with your code modifications (if needed). 

swmm5_ms.vcxproj Download this file

Friday, December 28, 2012

Singapore - Catching Every Drop of Rain

Singapore - Catching Every Drop of Rain

The source of the map of the rivers of Singapore is the Singapore PUB
As a small island that doesn't have natural aquifers and lakes and with little land to collect rainwater, Singapore needs to maximize whatever it can harvest.
Currently, Singapore uses two separate systems to collect rainwater and used water. Rainwater is collected through a comprehensive network of drains, canals, rivers and stormwater collection ponds before it is channelled to Singapore's 17 reservoirs for storage. This makes Singapore one of the few countries in the world to harvest urban stormwater on a large scale for its water supply.
The newest reservoirs are Punggol and Serangoon Reservoirs which are our 16th and 17th reservoirs. By 2011, the water catchment area has increased from half to two-thirds of Singapore’s land surface with the completion of the Marina, Punggol and Serangoon reservoirs.
With all the major estuaries already dammed to create reservoirs, PUB aims to harness water from the remaining streams and rivulets near the shoreline using technology that can treat water of varying salinity. This will boost Singapore’s water catchment area to 90% by 2060,
The goal is to capture every drop of rain (Figure 1)


Reservoirs
Pandan ReservoirKranji Reservoir
Jurong Lake ReservoirMacRitchie Reservoir
Upper Peirce ReservoirLower Peirce Reservoir
Bedok ReservoirUpper Seletar Reservoir
Lower Seletar ReservoirPoyan Reservoir
Murai ReservoirTengeh Reservoir
Sarimbun ReservoirPulau Tekong Reservoir
Marina ReservoirSerangoon Reservoir
Punggol Reservoir

Rivers
Singapore RiverSungei Kallang
Rochor RiverSungei Whampoa
Geylang RiverSungei Bedok
Sungei KetapangSungei Changi
Sungei SelarangSungei Loyang
Sungei TampinesSungei Api Api
Sungei BlukarSungei Serangoon
Sungei PunggolSungei Tongkang
Sungei PinangSungei Seletar
Sungei Khatib BongsuSungei Seletar Simpang Kiri
Sungei SembawangSungei Mandai
Sungei ChinaSungei Mandai Kechil
Sungei Peng SiangSungei Tengah
Sungei KangkarSungei Buloh Besar
Sungei JurongSungei Lanchar
Sungei PandanSungei Ulu Pandan



Thursday, December 27, 2012

Advances in artificial intelligence: deep learning

Advances in artificial intelligence: deep learning

November 25, 2012 – 12:34 am
If you want to keep up with advances in artificial intelligence, the New York Times has an essentialarticle on a recent step forward called deep learning.
There is a rule of thumb for following how AI is progressing: keep track of what Geoffrey Hinton is doing.
Much of the current science of artificial neural networks and machine learning stems from his work or work he has done with collaborators.
The New York Times piece riffs on the fact that Hinton and his team just won a competition to design software to help find molecules that are most likely to be good candidates for new drugs.
Hinton’s team entered late, their software didn’t include a big detailed database of prior knowledge, and they easily won by applying deep learning methods.
To understand the advance you need to know a little about how modern AI works.
Most uses abstract statistical representations. For example, a face recognition system will not use human-familiar concepts like ‘mouth’, ‘nose’ and ‘eyes’ but statistical properties derived from the image that may bear no relation to how we talk about faces.
The innovation of deep learning is that it not only arranges these properties into hierarchies – with properties and sub-properties – but it works out how many levels of hierarchy best fit the data.
If you’re a machine learning aficionado Hinton described how they won the competition in a recent interview but he also puts all his scientific papersonline if you want the bare metal of the science.
Either way, while the NYT piece doesn’t go into how the new approach works, it nicely captures it’s implications for how AI is being applied.
And as many net applications now rely on communication with the cloud – think Siri or Google Maps – advances in artificial intelligence very quickly have an impact on our day-to-day tools.
 
Link to NYT on deep learning AI (via @hpashler)

Thursday, December 20, 2012

Maximum HGL Head Class in InfoSWMM AND H2OMAP SWMM

Maximum HGL Head Class in InfoSWMM AND H2OMAP SWMM

Maximum HGL Head Class in InfoSWMM AND H2OMAP SWMM

by dickinsonre
Maximum HGL Head Class in InfoSWMM AND H2OMAP SWMM
You can find the node flood or surcharge maximum occurrence during a simulation in the Junction Summary Report table in InfoSWMM and H2OMAP SWMM (Figure 1)
Empty                                   if the Node Head is below or equal to the Lowest Link Connecting  Elevation
Below Link Crown            if the Node Head is below or equal to the Highest Link Connecting Crown
Below Maximum Depth   if the Node Head is below or equal to the Node Invert + Full  Depth.  The column Max Surcharge Height above Crown will also tell you how deep the Surcharge in a Node.
Surchaged                           if none of the above is true.
Figure 1.  Junction Summary Report in InfoSWMM

Figure 2.  Maximum Surcharge Height above Crown Definition







Sunday, December 16, 2012

InfoSewer Inflow Control for a Pump with a Pump Curve

InfoSewer Inflow Control for a Pump with a Pump Curve

You can control the pumps in InfoSewer and H2OMap Sewer by using a Pump Control which will control the pump based on:

1.       Volume
2.      Level
3.      Discharge
4.     Inflow
5.      Time

If you use a By Inflow control the pump speed of the pump is increased or decreased to make the Upstream Wet Well Level Constant (Figure 1) for an exponential 3 point curve


InfoSewer By Discharge Control for PUMP

InfoSewer By Discharge Control for a PUMP

InfoSewer By Discharge Control for a PUMP

by dickinsonre
InfoSewer By Discharge Control for a PUMP
You can control the pumps in InfoSewer and H2OMap Sewer by using a Pump Control which will control the pump based on:
1.       Volume
2.      Level
3.      Discharge
4.      Inflow
5.      Time
If you use a By Discharge control the pump speed of the pump is increased or decreased to pump the incoming Wet Well flow based on the pump rules and the geometry of the Wet Well (Figure 1).
Figure 1.  By Discharge Control for  PUMP in InfoSewer and H2OMAP Sewer will change the Pump Speed of the pump to follow the Base Pump Flow Rules.


InfoSewer Inflow Control for a PUMP

InfoSewer Inflow Control for a PUMP

InfoSewer Inflow Control for a PUMP

by dickinsonre
InfoSewer Inflow Control for a PUMP

You can control the pumps in InfoSewer and H2OMap Sewer by using a Pump Control which will control the pump based on:

1.       Volume
2.      Level
3.      Discharge
4.      Inflow
5.      Time 
If you use a By Inflow control the pump speed of the pump is increased or decreased to make the Upstream Wet Well Level Constant (Figure 1).
Figure 1.  Inflow Control for  PUMP in InfoSewer and H2OMAP Sewer will change the Pump Speed of the pump to make the Wet Well level constant


Friday, December 14, 2012

LEGO, Brick by Brick

Brick By Brick
Enhanced-buzz-31955-1355155876-6
Chana Joffe-Walt examines Lego's dominance despite their products' high cost and lack of exclusive patent:
Lego goes to great lengths to make its pieces really, really well, according to David Robertson, who is working on a book about Lego. Inside every Lego brick, there are three numbers, that identify exactly what mold the brick came from, and what position it was in in that mold. That way, if there's a bad brick somewhere, the company can go back and fix the mold. For decades this is what kept Lego ahead. It's actually pretty hard to make millions of plastic blocks that all fit together.
Dreher recently sang the praises of the toy company. Tip, The Daily Dish

Thursday, December 13, 2012

InfoSewer Minimum Travel Time Sensitivity

InfoSewer Minimum Travel Time Sensitivity

InfoSewer Minimum Travel Time Sensitivity

by dickinsonre
InfoSewer Minimum Travel Time Sensitivity

The three Run manager parameters, Maximum Number of Segments, Minimum Travel Distance and the Minimum Travel Time in InfoSewer and H2OMAP Sewer affect the shape and flow attenuation of the flow in a link.  The effect of decreasing the Minimum Travel Time is to reduce the peak flow and spread out the flow as the number of segments increases(Figure 1).  The larger the Minimum Travel Time, which has the effect of decreasing the number of segments in a link up the limit of the parameter Maximum Number of segments, the smaller the peak and the more attenuation of the flow in InfoSewer.

There is three ways to control attenuation in InfoSewer: (1) use the flow attenuation option, (2) increase the Maximum Number of Segments per link and (3) decrease the Minimum travel distance.    You can also use all three parameters to make more segments per link for long links and only a few segments for short links.
Figure 1.  Effect of the Minimum Travel Time in InfoSewer and H2OMAP Sewer



InfoSewer Minimum Travel Distance Sensitivity

InfoSewer Minimum Travel Distance Sensitivity

The three Run manager parameters, Maximum Number of Segments, Minimum Travel Distance and the Minimum Travel Time in InfoSewer and H2OMAP Sewer affect the shape and flow attenuation of the flow in a link.  The effect of decreasing the Minimum Travel Distance is to reduce the peak flow and spread out the flow as the number of segments increases(Figure 1).  The smaller the minimum travel distance, which has the effect of increasing the number of segments in a link up the limit of the parameter Maximum Number of segments, the smaller the peak and the more attenuation of the flow in InfoSewer.

There is three ways to control attenuation in InfoSewer: (1) use the flow attenuation option, (2) increase the Maximum Number of Segments per link and (3) decrease the Minimum travel distance.    You can also use all three parameters to make more segments per link for long links and only a few segments for short links.


Wednesday, December 12, 2012

How to Make an Excel Fixed Width File from SWMM 5

How to Make an Excel Fixed Width File from SWMM 5

How to Make an Excel Fixed Width File from SWMM 5

by dickinsonre
How to Make an Excel Fixed Width File from SWMM 5
You can use this macro for MATLAB or some other DOS based program by using the Tools command of SWMM 5 and configuring the EXCEL file option.  If you use the EXCEL tool then your SWMM 5 input file will be opened up in EXCEL and you can use this macro to make a fixed format file for SWMM 5.  Note, SWMM 5 does not use fixed format but other programs may need it for reading,  You adjust the column widths in the macro for your program.
Here is the macro, which is placed  in Excel using these command:
  1. Copy the code above.
  2. Open Excel.
  3. Alt + F11 to open the Visual Basic Editor.
  4. Click Insert-Module from the menu.
  5. Paste the code into the window that appears at right.
Option Explicit
Sub CreateFixedWidthFile(strFile As String, ws As Worksheet, s() As Integer)
    Dim i As Long, j As Long
    Dim strLine As String, strCell As String
    
     'get a freefile
    Dim fNum As Long
    fNum = FreeFile
    
     'open the textfile
    Open strFile For Output As fNum
     'loop from first to last row
     'use 2 rather than 1 to ignore header row
    For i = 1 To ws.Range("a65536").End(xlUp).Row
         'new line
        strLine = ""
         'loop through each field
        For j = 0 To UBound(s)
             'make sure we only take chars up to length of field (may want to output some sort of error if it is longer than field)
            strCell = Left$(ws.Cells(i, j + 1).Value, s(j))
             'add on string of spaces with length equal to the difference in length between field length and value length
            strLine = strLine & strCell & String$(s(j) - Len(strCell), Chr$(32))
        Next j
         'write the line to the file
        Print #fNum, strLine
    Next i
     'close the file
    Close #fNum
    
End Sub
 'for example the code could be called using:
Sub CreateFile()
    Dim sPath As String
    sPath = Application.GetSaveAsFilename("SWMM5_Fixed_EXPORT", "Text Files,*.inp")
    If LCase$(sPath) = "false" Then Exit Sub
     'specify the widths of our fields
     'the number of columns is the number specified in the line below +1
    Dim s(15) As Integer
     'starting at 0 specify the width of each column for the SWMM5 File, alter the columns if you need more columns in your data input file
    s(0) = 40
    s(1) = 20
    s(2) = 20
    s(3) = 20
    s(4) = 20
    s(5) = 20
    s(6) = 20
    s(7) = 20
    s(8) = 20
    s(9) = 20
    s(10) = 20
    s(11) = 20
    s(12) = 20
    s(13) = 20
    s(14) = 20
    s(15) = 20
     'for example to use 3 columns with field of length 5, 10 and 15 you would use:
    'dim s(2) as Integer
     's(0)=5
     's(1)=10
     's(2)=15
     'write to file the data from the activesheet
    CreateFixedWidthFile sPath, ActiveSheet, s
End Sub
 .

Tuesday, December 11, 2012

Batch Simulation in InfoSewer, InfoSWMM or InfoWater

Steps to set up a new icon for Batch Simulation in InfoSewer, InfoSWMM or InfoWater
1. Customize Arc GIS
2. Add an Icon
3. Run the command using the Icon


Sunday, December 9, 2012

InfoSewer Maximum Number of Segments Sensitivity

InfoSewer Maximum Number of Segments Sensitivity

InfoSewer Maximum Number of Segments Sensitivity

by dickinsonre
InfoSewer Maximum Number of Segments Sensitivity

The three Run manager parameters, Maximum Number of Segments, Minimum Travel Distance and the Minimum Travel Distance in InfoSewer and H2OMAP Sewer affect the shape and flow attenuation of the flow in a link.  The effect of decreasing the Minimum Travel Distance is to reduce the peak flow and spread out the flow as the number of segments increases(Figure 1).  The smaller the minimum travel distance, which has the effect of increasing the number ofsegments in a link up the limit of the parameter Maximum Number of segments, the smaller the peak and the more attenuation of the flow in InfoSewer.

There is three ways to control attenuation in InfoSewer: (1) use the flow attenuation option, (2) increase the Maximum Number of Segments per link and (3) decrease the Minimum travel distance.    You can also use all three parameters to make more segments per link for long links and only a few segments for short links.

GitHub code and Markdown (MD) files Leveraging

 To better achieve your goal of leveraging your GitHub code and Markdown (MD) files for your WordPress blog or LinkedIn articles, consider t...