GIS and Cartography
For all those Americans, who think your political culture is uniquely corrupt or tarnished by money or special interests, I give you, direct from Canada, in all its astroturfing glory, "Ethical Oil".
My favorite part is the donation area, "Please consider making a $5, $10 or $15 donation..." because of course ethicaloil.org relies "on small donors like you to sustain our grassroots advocacy". They won't take money "from foreign corporations, foundations, governments, or lobbyists", so it's a good thing there's lots of money available from CANADIAN corporations, foundations and lobbyists.
I took the kids to school this morning after reading this and especially this so my tolerance for people who think time-shifted mass murder is ETHICAL is a little lower than usual today.
Hello, all my dark minions in the consulting industry!!! Have you ever low-bid a contract, knowing that once you got deep into it, the client would be as professionally invested in the success of the project as you, and would carry the can back to management for more funding? Come on, chums, you can be honest with me, didn't we row together at Oxford?
Sadly, our old mates at Oracle got their hands caught in the cookie jar recently. They thought they were building a strategic vendor relationship with Montclair State University. Everyone was friends, all pulling together for success, and then some loser decided to knife them in the back instead of being chums!
"When issues arose during the course of the project, it became clear that MSU's leadership did not adequately understand the technology and the steps necessary to complete the project," [Oracle] stated. "Instead of cooperating with Oracle and resolving issues through discussions and collaboration, MSU's project leadership, motivated by their own agenda and fearful of being blamed for delays, escalated manageable differences into major disputes."Right ho! Instead of "cooperating" and "resolving through discussions and collaboration" (oh! and an extra $15M!) they created a major dispute. Bollocks! It's this kind of unfriendliness and lack of trust that can turn a super strategic friendship and awesome partnership relationship into a garden variety contractual business arrangement, and who wants one of those?!?
And, to add to the betrayal, I guess someone at MSU used to work in the consulting industry (zounds!)
"This is a textbook example of how to file a legal action against a vendor for failure to deliver," said analyst Ray Wang, CEO of Constellation Research, who reviewed the updated complaint on Wednesday.
MSU made some smart moves to protect itself, such as documenting all conversations and interactions with Oracle, and working out an escalation procedure in the event the project ran into problems. It also was wise to use real-life use cases for the demonstrations, Wang added.
I'm glad I live in a jurisdiction where clients and vendors know how to get along.
I find much to love in the BC CIO's "IM/IT Enablers Strategy v1.5 for Citizens @ the Centre: B.C. Government 2.0" (well, perhaps not the name!) but there is one section that chills me to the core: Strategic Procurement.
At the heart of "strategic procurement" is the "strategic vendor relationship" (SVR), wherein "enhancing the government's relationship with key vendors [emphasis mine] will lead to more agility in responding to new needs, or making full use of emerging technologies". What part of working with "key vendors" enhances government's power in the vendor/customer relationship? Where do market forces come into play?
How will we know which vendors are strategic and which ones are a waste of our time? Will we play golf with them? And those non-strategic vendors, what of them? Do they get to play golf too?
Verily, there is only one place this leads, and the name of the beast is "Master Standing Agreement", or more colloquially, the "[HP|IBM|Accenture] Always Gets a Piece Act". The same actors will be arranged in the marketplace, but the small ones will only get to access work via large ones, who will always get a (the most) lucrative piece.
It's nice that the BC IT bureaucracy is coming to grips with its co-dependent relationship with the big consultancies, but unfortunate that the reaction is to formalize co-dependence as desirable in the master strategic plan.
(Note to readers: I've heard talk of a "vendors solutions center" or something like that floating around, anyone have any links or documents they can share?)
This (and everything else, it seems) reminds me my favourite technology joke, from circa 1995: How many Microsoft engineers does it take to change a lightbulb? None, Bill Gates just declares darkness to be the new standard.
I really enjoyed Mike Monteiro's talk, "F*ck you. Pay me." and it curiously fits into my current writing jag: finding value in your "cost centers".
The curse of IT is that it is a cost center, not a profit center. This is true even for an internet company like Amazon — the profit is in selling those damn books not in running the web site (OK, not true anymore, with Amazon Web Services, Amazon is actually monetizing IT directly now, but cut me some slack here).
As a cost center, the only way IT can directly contribute to the bottom line is to reduce costs. And if IT is managed in a silo, separate from line business (or worse, outsourced), things can go seriously sideways. Reduced services and responsiveness from IT can reduce effectiveness or hamstring line business areas that do generate profits. In chemistry terms, IT is not the reactant, it's the catalyst, but it's still critical to generating the reaction!
What does this have to do with Mike's profane little talk? One of his main points is that, in running his creative business, his legal advisor has been absolutely critical. As Mike says (pointing to his lawyer) "this guy makes me money". Well, no, taking the narrow view, the lawyer only ever receives money, he never gives it back. But in the global view, looking at all the money the company didn't lose due to bad contracts, or due to broken customer relationships, or due to misunderstandings of obligation, Mike's lawyer has generated far more value than he has billed out. He's a quiet profit center.
If you treat it right, IT can do that too.
Our article about upcoming PostGIS 2.0 just came out recently in GeoInformatics December Issue (issue 8). If you want to know what all the buzz is about with PostGIS 2.0, read the article which starts on page 30.More changes in PostGIS 2.0
On another interesting note -- some new changes have happened in PostGIS 2.0. The raster loader is now a regular executable similar to shp2pgsql so no more need for python configuration or python at all. People had a lot of trouble getting the python bindings right to load data. Hopefully this should simplify things. Many thanks to Bborie Park for getting this done before 2.0 release. It was an extremely exciting surprise. Read Loading rasters in PostGIS 2.0 and see how easy it is. There is also the new ST_GeomFromJSON function which should be a hot addition for web mapping developers. If you are on windows, we have 32-bit experimental builds with all this functionality in the PostGIS Windows experimental downloads section for 8.4-9.1. Note that the experimental binaries don't require any installation, just copy the files into your PostgreSQL install and you are good to go. If you want to do a self-standing portable PostgreSQL which is what we normally do for testing on various PostgreSQL instances - check out our Starting PostgreSQL in windows without install.
What I find most cool about the new raster support is that it's so easy to use without any add-ons because it has all these SQL image export functions. Most of the images we have in the PostGIS 2.0 documentation we created using our make-shift ad-hoc raster/geometry viewers which uses nothing but the PostgreSQL drivers you use in PHP and ASP.Net. We'll be discussing that in an upcoming article. Even though the viewers we created are PHP and ASP.NET, it's just as simple to do in any language say Java and PostgreSQL JDBC driver. Any tool you can use to render saved images in a database, you can take advantage of raster support. I still have in my todo to embed in my reports that require light mapping.Raster is not just for raster lovers anymore
What most people don't realize about the PostGIS 2.0 raster support is that it enhances the PostGIS geometry support as well. It has functions that allow you to output geometries as raster and overlay them with rasters. This allows you to for example overlay a parcel footprint on top of an aerial image without anything but PostGIS, SQL and your favorite language of choice. We also have ST_Union aggregation functionality for raster which means you can union raster tiles with SQL. You can even clip a raster by a geometry. I'm really very excited about the limitless potential for both standard raster users and geometry-only users that the new raster functionality provides.Stay tuned for another book from us
We just got another book contract accepted. More on that once things become more final. It is not about PostGIS this time, but PostgreSQL. Yes we are going back to our database roots a bit. We've always thought of ourselves as web application / financials applications / database programmers who accidentally stumbled into the forest of GIS. We hope this new book will be most useful to programmers with not so much experience with databases and PostgreSQL specifically.
Hot on the heels of my post about doing work in house, InfoWorld's Deep End column takes a look at build-vs-buy.
Relying solely on support contracts and generic solutions is a good way to self-limit the agility and performance of any business. In short, more gurus equals less hand-wringing and stress all around.In an era when software is eating the world, information agility is key to competitiveness (or, in government terms, "effective service delivery"), when competitors are investing heavily in brain power, why would any organization dumb itself down?
This morning, I was struck by this nice write-up about how the Hungarian railway accurately geo-located and inventoried their assets:
The work was done entirely by MAV employees which made it much less expensive than if external contractors would have had to have been used. Overall it is estimated that as a result of using internal resources and a GPS/GLONASS-based approach the project was 16 times more efficient than a traditional survey. And the project generated a lot of pride among MAV employees who carried out the work because it was such a remarkable achievement from a data collection, management and quality perspective.Here's is an incredibly stupid thing for a consultant to say, but nonetheless: if you can do it in house, why wouldn't you? Even if it's a bit of a stretch, your in house resources:
New IT infrastructure is strategic almost by definition. Why would you outsource your most important strategic initiatives? If you're anticipating failure, perhaps it's a good idea. But if you succeed, you've just invested in building intellectual capital in a population of people outside your organization. And you've lowered the engagement of your core staff in the future of the organization.
Familiarity breeds contempt, and it's all too common that management is most contemptuous of the people they are most familiar with: their own staff. Hence the lure of the shiny consultant (love me! I'm shiny!).
One of the nerdy highlights of my year is the always the annual North American code sprint (previously held in Toronto (2009), New-York (2010) and Montreal (2011)). It started out as a MapServer, C-Tribe kind of thing, but has also had participants from the OpenLayers and GeoServer community too. Basically, if you have an open source geoproject and a team of more than one, the sprint is an excellent opportunity to get face time and serious progress under your belt.
This year, the sprint is on Bainbridge Island near Seattle and the nature of the venue (all inclusive, room, board, meeting space) means pre-registration is de riguer. So if you're coming, please register now.
GIS Day November 16th, 2011 has just about ended. Why end the celebration there when you can continue it the day after with Post GIS day. November 17th, 2011, the day after GIS has already arrived in many parts of the world and commemorates the PostGIS spatial database.
To ring in this new day, we have prepared some Post GIS Day 2011 Commemorative playing cards. These cards will provide many hours of joy, education, and laughter for the whole family or random crowd gathering.Get your Post GIS day 2011 Playing cards here
The Federal NDP is in a leadership race, which means that candidates who have paid their entrance fee have access to the membership list, some 100,000 Canadians like myself. As a political observer and data fiend, who had access to such a list myself only this spring, I love watching to see how people make use of it: do we get the standard policy screed, the informative candidate-is-visiting message, or something more devious... like the below!So, an email arrives stating:Dear Member of NDP,
I would really appreciate your participation in a study we’re currently conducting amongst members of the federal NDP.
I recognize that you’re busy, so this survey is very straightforward and can easily be completed online at your convenience, in about 15 minutes. Please complete the survey before Tuesday November 15th.
All information provided by respondents will be kept strictly confidential and used only for legitimate research purposes. Study sponsors will not have access to your name, address or phone number.
To begin the survey, simply click on the link below. If your email does not support hotlinks, copy and paste the link into your browser.
If you encounter any problems, please contact me at the e-mail address below.
Thank you in advance for participating in our survey.
Project Management Team Leader
email@example.comThe fact that they have the NDP membership list, and the content of the poll, lead me to believe it is associated with a leadership campaign in some way. But it's been done anonymously. The campaign that has done this both (a) gets the data and (b) pretty much ensures that anyone else trying the same gambit will get a much lower response rate. The poll itself is very long, I wonder how many full responses they get? I also wonder if there will be any blowback for using the list in this way? Based on the content of the poll, which campaign do you think is behind it? If the answer seems obvious, and you think there will be blowback, could the poll in fact be the product of a different campaign? Ain't politics grand?
Update: Just to leave no stone unturned, I asked the researcher who commissioned the study, but the answer is not illuminating:The Logit Group is a Gold Seal Member Agency of the Marketing Research and Intelligence Associaton (MRIA), Canada's governing body for all market research firms. As such, we conform to all regulations related to privacy and confidentiality. In this instance, the organization that provided us with member lists required that the survey be completed in a confidential, or "blind" method (whereby the survey sponsor was not identified at the outset). In return, the responses of individual members (such as yourself) would not be attributed to you specifically when reported back (survey findings would only be provided in aggregate form).
Which language would you prefer to complete this survey in? Dans quelle langue préférez-vous répondre à ce sondage?
We are interviewing members of the NDP. Are you a member of this party?
How long have you been a member of the NDP?
And in which province do you currently reside?
Were you active for the NDP in the last federal election in May, 2011? (As a candidate, campaign worker, fundraiser, etc.)
As you may know, a leadership campaign has been scheduled for March 2012. Each member of the NDP will be eligible to cast a vote for their choice of leader.
As far as you know today, are you likely to be voting in this leadership election?
Thinking about the next federal election, do you think the NDP will win more seats, will win fewer seats or will win the same number of seats as it has currently?
How confident are you that with a new leader, the NDP can defeat Stephen Harper in the next federal election and take over government?
How much do you think the NDP's chances of defeating Stephen Harper depends on who is selected as the new leader?
When you think about the federal NDP as a whole, where would you describe yourself in your own political thinking relative to the party?
Some people say that they would like to know where each of the leadership candidates stand and want them to spell out in detail the policy direction they want to take the party in.
Others say that they don't want the candidates to present detailed policy because the party members and caucus should have a say in the party's future direction after the leadership campaign.
Which of these two points of view best represents your own thinking?
Each political party has an establishment: a group of people who have been important to, and actively involved with, the party for some time either provincially, federally or both. What is your impression of the establishment of the NDP? Is it very favourable? Somewhat favourable? Somewhat unfavourable? Very unfavourable?
Do you consider yourself to be a member of the NDP establishment?
There has been some discussion about whether the NDP should at some point discuss a relationship or merger with the Liberal Party and the federal level in order to unite the centre left of the political spectrum. What would be your opinion of a move to discuss such a relationship or merger at some point in time? Would you be strongly in favour? Somewhat in favour? Somewhat against? Strongly against?
As you may know, one of the leadership candidates is proposing that wealthier Canadians should pay more in taxes. Would this make it more or less likely that you would support a candidate who proposed this, or would it make no difference in your support?
One of the policy issues being debated these days is the creation of a carbon tax for individuals and corporations who use hydrocarbon fuels and the use of rewards for those who reduce their carbon usage. Would you be strongly in favour, somewhat in favour, somewhat against or strongly against the NDP supporting the introduction of a carbon tax?
Different people have been telling us that they are looking for various things in the next leader.
From your own personal point of view, how important is it that the leader you choose ... (READ EACH OF THE FOLLOWING STATEMENTS) ... ? Is it extremely important, very important, somewhat important, not very important or not important at all? (REPEAT FOR EACH STATEMENT)
Now we would like to ask you to think about the candidates who have declared for the NDP leadership.
What is your impression of ... (READ EACH CANDIDATE'S NAME) ... as a leadership candidate? Is it very favourable? Somewhat favourable? Somewhat unfavourable? Or very unfavourable? (REPEAT FOR EACH CANDIDATE)
Overall, based upon what you know about these individuals or have heard, where would you put each of these candidates on the political spectrum in relation to the Federal NDP? Far to the right? Somewhat to the right? In the centre? Somewhat to the left? Far to the left?
Thinking about some of the leadership candidates, in your view, which of them ...
If the leadership vote was being held today, which of the leadership candidates would you be voting for? (Please select one only.)
How likely is it that you will change your mind and support another candidate before election day?
Who would be your second choice for leader?
Who would be your third choice for leader?
Are there any candidates for leader whom you could never vote for? (Please select all that apply.)
Which of the candidates do you think Jack Layton would have wanted to succeed him as leader?
Finally, I want to ask you about some of the personalities in the NDP.
If the following personality supported a particular leadership candidate, would that make it more or less likely that you would support that leadership candidate, or would it make no difference as to whom you supported.
I would like to ask your reactions to the following statements.
Please tell me whether you strongly agree, somewhat agree, somewhat disagree or strongly disagree with each of the following.
Some people say that the next NDP leader must continue with a positive approach to politics in order to motivate progressive voters to defeat Conservatives.
Others say that the next NDP leader must take a more confrontational approach to Stephen Harper because he needs to be faced down in order to be defeated in the next election.
Which of these statements is closest to your own point of view?
Some people say that the federal NDP has been basically on the right track since Jack Layton was elect ed leader and it should continue with this proven approach under a new leader.
Others say that the NDP has been on the wrong track and won't win government unless the new leader makes fundamental changes to the workings of the party.
Which of these statements is closest to your own point of view?
And finally, a few questions about you...
Which of the following best describes your current marital status...?
Do you, or did you, work in the private or public sector?
Are you currently, or have you ever been, a member of a union?
Are you a full-time student?
How would you describe the community in which you live?
While I know that most of us would classify ourselves as Canadians first, can you please tell me what your specific ethnic background is?
Which of the following categories best reflects your total annual household income before taxes?
Every week, LinkedIn kindly sends me a list of "jobs I might be interested in", which I have to say is an interesting feature, given the data they have to work with. Like the early days of Google advertising, it's fun to see what the algorithm comes up with as "relevant" to me. And this week I got this awesome, awesome, awesome, awesome entry:
Manager, Strategic Management
The Manager, Strategic Management is accountable for leading the development, maintenance and evaluation of corporate planning, performance management, benchmarking, risk management, and reporting programs. The position reports to the Chief Executive Officer of BC Assessment and works directly with the governing Board of Directors to facilitate strategic planning and risk management sessions. The position exercises considerable latitude and independence to oversee and develop a coordinated and consultative corporate plan, risk and performance management culture across BC Assessment. In this role, the position is expected to manage the corporate planning cycle to achieve a top to bottom linking of mandate and vision of operational business activities including the annual and year-over-year alignment of budgets, resource allocation, performance and risk management programs. This position leads a small team, including senior program analysts and a research officer.People I trust tell me BC Assessment has so much money, they really do eat $16 muffins for breakfast, but the existence of the "Manager, Strategic Management" is all the proof I need.
Every PostGIS version I try to make up a little cheatsheet of functions and uses. People seemed fond of these and I enjoyed doing them. One person suggested we need the function arguments listed. There was no way I was going to do that by hand. PostGIS 2.0.0 is much bigger unfortunately so if I were to do it by hand I would not do any parts justice, so this time I decided to add to the PostGIS code base a cheatsheet generator. which is called withmake cheatsheets
uses xsltproc and xsl style sheets to navigate the PostGIS documentation. One side effect is that its a bit easier to spot glaring errors in the documentations. I've been playing with css styling and xsl a bit more. A bit too much playing probably.
Here is what it generates so far. The postgis core one I cheated a bit because I wanted the columns sort of balanced and really wanted 2 columns. I will work on having this autogenerate probably by doing something crazy like having my xsl script count how many functions have been output and then start a new column in the middle. The only one I configured to output examples from the docs was the Tiger geocoder one, because the other added a significant number of pages. Will probably have to add flags to examples to have it selectively output some exampels and not others.
We have some other PostGIS videos listed on PostGIS FOSS4G 2011 videos have landed. We'll be adding some more to that list.
We have osme other PostGIS videos listed on PostGIS FOSS4G 2011 videos have landed. We'll be adding some more to that list.
We were able to attend some of FOSS4G this year and for the very first time too. Hopefully next time we can stay for the full conference. Overall it was an enjoyable time. We got to see many of the people in person we've only corresponded with via email and even bumped into one of our college fraternity brothers we haven't seen in twenty years. It is indeed a small world. We gave our talk on Friday on what's up and coming in PostGIS 2.0. We were a bit shocked at the vast number of people attending our session and all the PostGIS sessions in fact. Next time we'll try to make our presentation less dense. The density of the presentation does make for a good after the conference hand-out. WARNING: The following slides feature SQL doing unconventional things suitable only for mature audiences. Viewer discretion is adviced.. You can check out our slides here PostGIS 2.0 the new stuff.
I think the last time we were in the Denver area (not counting airport stops) was when we were driving from Cambridge, Massachusetts to Stanford, California and we got stuck in a hail storm. Since we were in town, we thought we'd take in one of the nearby sites we've always fantasized about visiting; Casa Bonita Restaurant as featured in South Park. I wasn't expecting it to look or be quite as portrayed in South Park, especially the cave divers and waterfall. Indeed there were cave divers plunging every 30 minutes off the water fall and a Black Bart's Cave. We explored the cave and various other cavities of the restaurant and picked up some gifts at the gift shop to take back. The sopapillas were super delicious too as Cartman described. Then we went for dinner to eat some game food -- like Rocky Mountain Oysters. I exclaimed to Leo -- "these do not taste anything like oysters, not particularly interesting taste". To which he laughed and said "You've never tasted these oysters before." Had I known they were Rocky mountain oysters before-hand I might have appreciated the flavor a little more.
On Saturday we had the code sprint and the whole PostGIS clan (including remote folks) got together to strategize on the details of PostGIS 2.0 which includes the feature freeze, final expected release, what we would try to get done before release and what we would set aside for the future. A very strong showing of people about 8 local and several more on PostGIS IRC. The details are sketched on the PostGIS 2011 Sprint etherplans page. We will have Feature Freeze sometime in November and release Early 2012.
In the last article Minimalist Web based ASP.NET PostGIS 2.0 Spatial Geometry/Raster Viewer, we mentioned that we would provide a PHP equivalent. Well before we were able to lift our fingers, Bborie created a PHP version o the postgis handler and gave us a copy. For those running PHP, you can download it from http://www.postgis.us/downloads/postgis_webviewer_php.zip
One of the things I'm most excited about in upcoming PostGIS 2.0 are the raster output functions, largely created by Bborie Park. The latest one he added ST_AsRaster should be a welcome addition to even those who don't care about raster because it allows you to convert regular PostGIS geometries to PostGIS raster and then use all the available export functions to output to your favorite image format without ever leaving the database. If you want to try out PostGIS 2.0 and are on windows, you can download compiled versions for PostgreSQL 8.4-9.1 at: http://www.postgis.org/download/windows/experimental.php#PostGIS_2_0_0
This means that PostGIS is now both a spatial as well as a graphical database engine. To test out how I would take advantage of these new features, I decided to create a mini ASP.NET 2.0+ app that is a PostGIS ad-hoc query viewer for both PostGIS geometry and raster. We have it written in both VB.NET and C# and are planning to follow up very soon with a PHP version. We'll also be putting up an online version and tutorial for people to play with who don't have PostGIS 2.0 installed so they can see what they are missing out on :). You can also download the source code from: http://www.postgis.us/downloads/postgis_webviewer_aspnet.zip
We'll be attending FOSS4G2011 in Denver this year, giving a tour of all the new treats in PostGIS 2.0 which will include this as well as PostGIS geometry analysis and maintenance functions/changes, 3D support types and functions, Topology, and Tiger Geocoder. If you are attending, please attend our talk on Friday PostGIS 2.0, the new stuff.The Application Makeup
The application is very simplistic and is composed of 3 parts:
Check out these snapshots
I'm hoping in the very near term future to combine this with my favorite .NET reporting engine -- ActiveReports.NET which I currently use for my PostGIS based web apps and which can take database fields consisting of blobs of images. Being able to auto generate an image from spatial data to go in a report will be slick beyond imagination.