data modeling - MLS Database Schema -

-

I am trying to prepare an app that will take a real estate MLS (multiple listing service) data from a CSV and Insert I have CSV parsing in this database, but I'm having trouble making the database efficient. The problem is that the MLS data provider is known to change the nature of property information without changing the information quickly. That's why there is a table, which with 1-to-two-match data will probably cause problems in loading data in the future. It seems that most developers put each element in one line. IE is my current setup: 

  id = int property_id = longint element_key = char element_value = text

As you can imagine from 1000s of these qualities Very slow about 80+ elements with each.

How can I make it more efficient but make the database flexible?

And yes, I know about memcache and plan to use it.

You are at the mercy of the data providers, unless there is no way to control them. This has been the effect of database work for almost fifty years, and it is unlikely to change anytime soon. Using CSV is nothing to do with the underlying problem.

I suspect that this is not just a format of data, which changes, but also has the vocabulary of data, even if you did not say it.

Your best bet is to have one or more lofty tables that can record a lot of CSV data in the format you receive. Whenever the providers change things on you then be prepared to change these tables then write some procedures that change this data into a suitable form for your base tables, and copy the converted tables into the base tables. These procedures will require periodic maintenance, but will remain more stable in your base tables, unless you need to store more information in accordance with the changes provided by the suppliers.

If the database should be fully dynamic to keep data with your changing input, then you are stuck with some models like EAV, which is completely unaware of the logical structure of the data. This ignorance is very dynamic for EAV, but it will create havoc for you when you look for EAV data in meaningful information.


Comments

Post a Comment

Popular posts from this blog

asp.net - Javascript/DOM Why is does my form not support submit()? -

-
This is my first time working with asp.net and javascript, so I do not know very good web resources, or Much about javascript debugging I have to find out that on line oFormObject.submit (); Microsoft JScript Runtime Error: Object does not support this property or method I am using the link to work as a button because I am terrible in aesthetics and I think That link will look more professional than a table of 50 buttons. I have read that this solution can cause problems with browsers due to pre-rendering of my links and many additional traffic and problems, but CSS gives me a button like a link, which has issues of alignment and difference seemed to. & lt ;! DOCTYPE HTML PUBLIC "- // W3C // DTD HTML 4.01 // N" "http://www.w3.org/TR/html4/strict.dtd"> & Lt; Html xmlns = "http://www.w3.org/1999/xhtml" & gt; & Lt; Head & gt; & Lt; Link rel = "stylesheet" type = "text / css" href = "defect differen
Read more

sockets - Delphi: TTcpServer, connection reset when reading -

-
I am trying to implement one for Delphi, but there are some problems with communication. Fitnesse will start my process, and give me a portmember as a command line argument. Then I should make a socket on the port number given to me, and fitness will connect to that port I am using a TCPCP server for the job: < Pre> TcpServer1.LocalPort: = ParamStr (ParamCount); TcpServer1 Active: = true; On OnEXEPT () -Event, I send the protocol version to use as specified in the protocol. Process TForm1.TcpServer1Accept (From: TOBject; ClientSocket: TCustomIpClient); Var s: ansistring; Start clientSocket. Syndrome ('slim - v 0.0', # 10); SetLength (S, 6); ClientSketts Receavebook (S, 6); End; When I call ReceiveBuf (), the process ends, and fitness throws an exception: java.net.SocketException: connection Reset I have seen what sent and received. It shows that my code sends the protocol version, fitness sends back a message, and when I try to get this message
Read more

javascript - Classic ASP "ExecuteGlobal" statement acting differently on two servers -

-
I have a strange problem that I really do not know. In addition to developing a new ASP.NET site, I have to support the old "classic ASP" site. It is written in VBScript with a batch of JavaScript functions. Many of the JavaScript functions include 'files' Everything is fine on our production system (which security is controlled by another group - this is a military installation) Debugging them once did not work I). However, I have a fix for a vague bug that needs to be fully tested and some functions do not run under the "local" copy of the website that runs on my PC. For the record, I am running IIS 5.1 on XP. The problem is that some Javascript functions are running "OK" on the production server, but when they use it as a server, they are not defined on my PC what is happening that last Programmer, for some reason, has decided to put some functions in a series of files, which according to the observations, imitate the "need_once
Read more