c# - Perform Data Analysis on Sql Server or in .Net? -

-

I have some data analysis that needs to be performed. On average, somewhere in between this would be somewhere between 50K-150K rows. From these lines, I need to remove the sum of the calculus (x) along with the sum (x) plus five different criteria. There are two ways to go about this:

  1. Write 10 different questions, designed to collect data from column X using each of the equals () or calculations () has gone. Run each and get results using SqlCommand.ExecuteScalar ().
  2. Create a custom object to include all the different criteria, which is necessary to evaluate different situations. Run a query that will return all the data needed to create a superset of all different conditional subsets using SQL Commands.execcadata reader (). Read each line from the DataReader in a new object, adding each list to the list store. All data is retrieved, use Linq-to-Object to define different amount () and calculation values ​​() based on different conditions.

I know that I can try every one to see what is the fastest, but I am interested in the advice of the community on which one can swiftly assume Take that the SQL server and the web server are running on each machine, enough memory with each

Right now I am leaning towards Option 1. However, there are many more questions for DB, DB itself will do aggregation and very few data on SQL server and web server. With Option 2, there is only one query, but it will send a very large amount of data to the net. Net, and then. Net will have to bear all heavy load in relation to overall tasks (and though I do not have anything on the basis of it, I suspect that the SQL server is more efficient in running such a large number of tasks).

Any idea to go the way (or a third option which I am missing)?

The database is usually the best option for analyzing data like this, and I # Had to go for 1.

However, I also consider the third option, in which you make a single query, which you do with SQL (in place of ten). It may involve involving a case statement in total tasks, so that you can do all the work at the same passage of data.

Think of the old way of pivoting: 

  SELECT SUM (case when condition X = 1 then some filed END) as SUM1 SUM (case when condition X = 2 Then some field-end) Sour2 with Sourdata;

Comments

Post a Comment

Popular posts from this blog

asp.net - Javascript/DOM Why is does my form not support submit()? -

-
This is my first time working with asp.net and javascript, so I do not know very good web resources, or Much about javascript debugging I have to find out that on line oFormObject.submit (); Microsoft JScript Runtime Error: Object does not support this property or method I am using the link to work as a button because I am terrible in aesthetics and I think That link will look more professional than a table of 50 buttons. I have read that this solution can cause problems with browsers due to pre-rendering of my links and many additional traffic and problems, but CSS gives me a button like a link, which has issues of alignment and difference seemed to. & lt ;! DOCTYPE HTML PUBLIC "- // W3C // DTD HTML 4.01 // N" "http://www.w3.org/TR/html4/strict.dtd"> & Lt; Html xmlns = "http://www.w3.org/1999/xhtml" & gt; & Lt; Head & gt; & Lt; Link rel = "stylesheet" type = "text / css" href = "defect differen
Read more

sockets - Delphi: TTcpServer, connection reset when reading -

-
I am trying to implement one for Delphi, but there are some problems with communication. Fitnesse will start my process, and give me a portmember as a command line argument. Then I should make a socket on the port number given to me, and fitness will connect to that port I am using a TCPCP server for the job: < Pre> TcpServer1.LocalPort: = ParamStr (ParamCount); TcpServer1 Active: = true; On OnEXEPT () -Event, I send the protocol version to use as specified in the protocol. Process TForm1.TcpServer1Accept (From: TOBject; ClientSocket: TCustomIpClient); Var s: ansistring; Start clientSocket. Syndrome ('slim - v 0.0', # 10); SetLength (S, 6); ClientSketts Receavebook (S, 6); End; When I call ReceiveBuf (), the process ends, and fitness throws an exception: java.net.SocketException: connection Reset I have seen what sent and received. It shows that my code sends the protocol version, fitness sends back a message, and when I try to get this message
Read more

javascript - Classic ASP "ExecuteGlobal" statement acting differently on two servers -

-
I have a strange problem that I really do not know. In addition to developing a new ASP.NET site, I have to support the old "classic ASP" site. It is written in VBScript with a batch of JavaScript functions. Many of the JavaScript functions include 'files' Everything is fine on our production system (which security is controlled by another group - this is a military installation) Debugging them once did not work I). However, I have a fix for a vague bug that needs to be fully tested and some functions do not run under the "local" copy of the website that runs on my PC. For the record, I am running IIS 5.1 on XP. The problem is that some Javascript functions are running "OK" on the production server, but when they use it as a server, they are not defined on my PC what is happening that last Programmer, for some reason, has decided to put some functions in a series of files, which according to the observations, imitate the "need_once
Read more