data modeling - MLS Database Schema -

-

I am trying to prepare an app that will take a real estate MLS (multiple listing service) data from a CSV and Insert I have CSV parsing in this database, but I'm having trouble making the database efficient. The problem is that the MLS data provider is known to change the nature of property information without changing the information quickly. That's why there is a table, which with 1-to-two-match data will probably cause problems in loading data in the future. It seems that most developers put each element in one line. IE is my current setup: 

  id = int property_id = longint element_key = char element_value = text

As you can imagine from 1000s of these qualities Very slow about 80+ elements with each.

How can I make it more efficient but make the database flexible?

And yes, I know about memcache and plan to use it.

You are at the mercy of the data providers, unless there is no way to control them. This has been the effect of database work for almost fifty years, and it is unlikely to change anytime soon. Using CSV is nothing to do with the underlying problem.

I suspect that this is not just a format of data, which changes, but also has the vocabulary of data, even if you did not say it.

Your best bet is to have one or more lofty tables that can record a lot of CSV data in the format you receive. Whenever the providers change things on you then be prepared to change these tables then write some procedures that change this data into a suitable form for your base tables, and copy the converted tables into the base tables. These procedures will require periodic maintenance, but will remain more stable in your base tables, unless you need to store more information in accordance with the changes provided by the suppliers.

If the database should be fully dynamic to keep data with your changing input, then you are stuck with some models like EAV, which is completely unaware of the logical structure of the data. This ignorance is very dynamic for EAV, but it will create havoc for you when you look for EAV data in meaningful information.


Comments

Post a Comment

Popular posts from this blog

MySql variables and php -

-
I am getting an error with php in order to format mysql_query () in php to format this string What is the right way? SELECT SELECT SELECT (*) Agents @AgentCount; User_Agent_English, User_Angent_Oursal, US.___Gent_Aginal, COUNT (User_Agent_Percade) ACC, COUNT (*) / (AgentCount) Percentage by agents user_agent_preser order DEC limit limit 50; In PHP, how am i setting $ query $ query = "SELECT count (*) agents @ agentcount; SELECT user_agent_parsed, User_agent_original , COUNT (user_agent_parsed) ascount, COUNT (*) / (@AgentCount) as a percentage by user_agent_parced by URI date DESC limit 50 "; This exact query will work properly if I put it in MySQL directly through a command line session. Do I need to release two separate php calls from mysql_query () and store the results first? I get the following error: There is an error in your SQL syntax; Instead of using a sub-selection and instead of using the 'SELECT user_agent_parsed, user_agent_original, ne...
Read more

url rewriting - How to implement the returnurl like SO in PHP? -

-
This URL should work even after the rewrite. Is this possible? Otherwise, I can only hardcoded everything If you are trying to create a login system with redirection You need to use the HTTP_REFERER header to find out where the user came from so that you can send it back there. The best way to do this is to use something like this in your login form: // - Login php & Lt; Input type = "password" name = "password" /> & Lt; Input type = "hidden" name = "returnrelale" value = "& lt ;? php echo $ redirectURL ;? & gt;" / & Gt; & Lt; / Form & gt; Please note that some ISP, browser or proxy will delete the referrer header, so you can not rely on each user to work fully. If you use a statement, to check whether the header exists or not, you can send those users back to the homepage or whatever. Edit If you are looking to use $ _SERVER ['REQUEST_URI'], if you are running Apache It sho...
Read more

Which Python client library should I use for CouchdB? -

-
I am starting to experiment with CouchDB because it looks like we have the right solution to certain problems That all the work will be on a new project, which does not have any legacy dependency, which the client library will suggest you use, and why? If we overlap any of the OS. Freeband is available only in the collection of its ports, but asks to use the library's project website. None of those people are Ubuntu, which is only with ships, since those two OSAs are not common in libraries, I am probably installing something from source (and hopefully if I have time, then Ubuntu and FreeBSD People pack the package). For those interests, I want to use CouchDB as a convenient intermediate storage space for data passed between different services - think of a message bus system, but less formalities with. For example, we have daemons that download and pars the web page, then send an interesting bit to other daemons for further processing. Many of them are ill-defined until the...
Read more