c# - Perform Data Analysis on Sql Server or in .Net? -

-

I have some data analysis that needs to be performed. On average, somewhere in between this would be somewhere between 50K-150K rows. From these lines, I need to remove the sum of the calculus (x) along with the sum (x) plus five different criteria. There are two ways to go about this:

  1. Write 10 different questions, designed to collect data from column X using each of the equals () or calculations () has gone. Run each and get results using SqlCommand.ExecuteScalar ().
  2. Create a custom object to include all the different criteria, which is necessary to evaluate different situations. Run a query that will return all the data needed to create a superset of all different conditional subsets using SQL Commands.execcadata reader (). Read each line from the DataReader in a new object, adding each list to the list store. All data is retrieved, use Linq-to-Object to define different amount () and calculation values ​​() based on different conditions.

I know that I can try every one to see what is the fastest, but I am interested in the advice of the community on which one can swiftly assume Take that the SQL server and the web server are running on each machine, enough memory with each

Right now I am leaning towards Option 1. However, there are many more questions for DB, DB itself will do aggregation and very few data on SQL server and web server. With Option 2, there is only one query, but it will send a very large amount of data to the net. Net, and then. Net will have to bear all heavy load in relation to overall tasks (and though I do not have anything on the basis of it, I suspect that the SQL server is more efficient in running such a large number of tasks).

Any idea to go the way (or a third option which I am missing)?

The database is usually the best option for analyzing data like this, and I # Had to go for 1.

However, I also consider the third option, in which you make a single query, which you do with SQL (in place of ten). It may involve involving a case statement in total tasks, so that you can do all the work at the same passage of data.

Think of the old way of pivoting: 

  SELECT SUM (case when condition X = 1 then some filed END) as SUM1 SUM (case when condition X = 2 Then some field-end) Sour2 with Sourdata;

Comments

Post a Comment

Popular posts from this blog

MySql variables and php -

-
I am getting an error with php in order to format mysql_query () in php to format this string What is the right way? SELECT SELECT SELECT (*) Agents @AgentCount; User_Agent_English, User_Angent_Oursal, US.___Gent_Aginal, COUNT (User_Agent_Percade) ACC, COUNT (*) / (AgentCount) Percentage by agents user_agent_preser order DEC limit limit 50; In PHP, how am i setting $ query $ query = "SELECT count (*) agents @ agentcount; SELECT user_agent_parsed, User_agent_original , COUNT (user_agent_parsed) ascount, COUNT (*) / (@AgentCount) as a percentage by user_agent_parced by URI date DESC limit 50 "; This exact query will work properly if I put it in MySQL directly through a command line session. Do I need to release two separate php calls from mysql_query () and store the results first? I get the following error: There is an error in your SQL syntax; Instead of using a sub-selection and instead of using the 'SELECT user_agent_parsed, user_agent_original, ne...
Read more

url rewriting - How to implement the returnurl like SO in PHP? -

-
This URL should work even after the rewrite. Is this possible? Otherwise, I can only hardcoded everything If you are trying to create a login system with redirection You need to use the HTTP_REFERER header to find out where the user came from so that you can send it back there. The best way to do this is to use something like this in your login form: // - Login php & Lt; Input type = "password" name = "password" /> & Lt; Input type = "hidden" name = "returnrelale" value = "& lt ;? php echo $ redirectURL ;? & gt;" / & Gt; & Lt; / Form & gt; Please note that some ISP, browser or proxy will delete the referrer header, so you can not rely on each user to work fully. If you use a statement, to check whether the header exists or not, you can send those users back to the homepage or whatever. Edit If you are looking to use $ _SERVER ['REQUEST_URI'], if you are running Apache It sho...
Read more

Which Python client library should I use for CouchdB? -

-
I am starting to experiment with CouchDB because it looks like we have the right solution to certain problems That all the work will be on a new project, which does not have any legacy dependency, which the client library will suggest you use, and why? If we overlap any of the OS. Freeband is available only in the collection of its ports, but asks to use the library's project website. None of those people are Ubuntu, which is only with ships, since those two OSAs are not common in libraries, I am probably installing something from source (and hopefully if I have time, then Ubuntu and FreeBSD People pack the package). For those interests, I want to use CouchDB as a convenient intermediate storage space for data passed between different services - think of a message bus system, but less formalities with. For example, we have daemons that download and pars the web page, then send an interesting bit to other daemons for further processing. Many of them are ill-defined until the...
Read more