Plz help me! I want to use SQL Server2000 DTS Import/Export Wi

I'd still suggest using either a bulk insert or bcp. After your last
explanation, maybe bcp would be better. It'll definitely be faster than
inserting a row at a time. First of all, you can do massive inserts without
logging which will reduce overhead and speed the process. Second, you can
write your C# code to change the bcp command line, for example, change the
table name or the test file path/name according to whatever parameters you
want. In your program, write the bcp command to a windows .bat file then
execute a shell to run the bat if that makes more sense. That way you have
the flexibility to change the insert parameters on the fly and you get the
speed of bcp inserts.
Other than performing an import from text to sql table, what do you mean by
this statement?
"i want to get the functionality of DTS from C#. i mean i want
to use SQL Server objects and libraries to perform SQL server related
tasks from my application."
"Adnan" wrote:

> thanks for sparing time for me.
> actually i have log files that are very huge sized like 700MB or even
> sometimes these reach upto GBs.
> i want to extract information from these files u can say i want to
> apply filters to get only required rows. log files are maintained by
> IIS and contain space seperated fields in each row and there are
> millions of rows.
> now currently i m reading file line by line and inserting that line
> into a database table. after that i select data from that table using
> different filtering criteria and then binding that selected data to a
> data grid.
> now the problem is when i use huge sized files the process becomes very
> slow and user hav to wait for a long time so that the file to be read
> line by line and get inserted into database line by line.
> there are different sample codes that are related to execute DTS
> packages. i want to get the functionality of DTS from C#. i mean i want
> to use SQL Server objects and libraries to perform SQL server related
> tasks from my application.
> i hope that now u hav understood the scenario. the other thing is if i
> create a DTS package from sql server and while executing it i want to
> change its attributes like file name at run time so that i give file
> name as a parameter and the package with that file name get executed.
> if u still hav confusions abt understanding scenario then plz do tell
> me.
> thanks.
> best regards.
>BCP is very much like "bulk copy" technically, but BCP is a dos command. Yo
u
can read all about it in the Sql Server Books Online.
What I'm suggesting is that you can write your C# code to dynamically create
or edit a BCP command in a .bat file (technically it's just a text file).
You can manipulate the file/folder name or even the sql server table name
that the BCP will load if that makes sense in your application. You can set
it to load a table from a formatted or delimited file. For example, you sai
d
you have a space separated file.
bcp is pretty easy to set up and runs quickly.
A simple example of a bcp command would look like this:
bcp "database1.dbo.tbl_target_table" in "c:\foldername\file1.txt"
-c /S"servername" /U"userid" /P"userpassword" -f"c:\foldername\formatfile.fm
t"
In this example, the process is to load an existing sql table
(tbl_target_table) from a text file (file1.txt) using a format file that you
pre-created (formatfile.fmt)
There are many options for BCP depending on your needs. You would be
interested in the -t (field terminator character) and the -r (row terminator
character) which is where you'd tell it that a space is a field terminator
and a Cr/LF is the row terminator. As long as you can run a dos command fro
m
within C#, you can do this. BCP is part of Sql Server, not .Net per se, so
I
don't think you'll have any problems with your version.
"Adnan" wrote:

> hy
> thanks again :-)
> r u talking about SqlBulkCopy? is it BCP? as far as i know about
> it(SqlBulkCopy), it is supported in version 2 of Dot net and in my
> company we r using version 1.1. so if BCP is SqlBulkCopy then it is not
> possible now. and if this is other thing then i m going to check it and
> plz i'll b very thankful to u if u provide me related web links or
> material along with ur valuable suggestions.
> as far as my statement is concerned actually i was going to use SQLDMO
> and finding solution via SQLDMO. at present i hav to only import txt
> files but in future may b i need it.
> i m really thankful to u that u spared ur time for me because i have
> posted this problem at different forums but u r the only ho replied.
> my email id is "adnan.developer@.gmail.com" if u like to attach some
> useful material.
> best regards.
>|||Adnan,
Sorry, I can't help you with C# code. I don't use it. But I've done
similar processes from VB. I suggest you try a different MS community for C
#
programming help. Ask about opening a Dos command shell from c#. I'm sure
you can do this, and it's probably not very difficult.
Microsoft's sites will mostly just describe the command and options, as you
found. They will not help much if you are looking for specific code. But,
there are some good IT community sites other than Microsoft that offer tips
and code for just about any languange. You can search for them on the web
probably find something useful quickly. Use your favorite search engine and
find "C# programming examples" Here's one I like to use: www.ittoolbox.com
You need to know two main programming concepts: 1 how to create/update a
text file from within c#. 2: how to open a dos command shell and execute a
.bat or .cmd command file.
To use it, your application must know how to set up the BCP. that is, your
app must know the pathname/file name of the the text data file an of the BCP
.bat file. That's up to you to determine. Next, you would need to write a
BCP command to the .bat file using the the path/file name of the data, and
the SQL server, database, table, etc. that will be loaded. Last, you need t
o
open a dos command shell, and tell it to execute the BCP .bat file. All of
this can be done in the application without the user intervention if that's
what you need to do.
Good luck.
"Adnan" wrote:

> hello
> how r u tthrone?
> i hav read ur suggestion and i think it is v close to my solution but
> one thing that i hav to telll u that i m not an expert of .net i m new
> to it.
> as i found abt BCp it is a command line utility as u also told. now the
> problem is that from where i can execute it? i mean i m going to make a
> GUI windows based application and i m confudsed that how to implement
> it in my windows based application. plz help me regarding:
> if BCP is a command line utility then fromn which command prompt i can
> execute it? .net command prompt or which.
> and how and where i hav to use it in my application. i dont want my
> user to go to any command prompt.
> actually as it looks i m not clear about BCP that how it works and how
> it is used.
> i'll b very very thankful to u if u help me in this regard because i
> have already taken very much time from company for this.
> plz if it is possible then do provide me some sort of code or at least
> try to clear the concept that what steps should b taken to use BCP from
> my C# application.
> or if u know the link of such a web page then plz tell me because i hav
> searched my best but couldnt find satisfactory help. i hav already
> searched MSDN library it only tell about BCP but doesnt tell that how
> to use it in my application. it just tells its syntax and parameters
> details.
> best regards.
> Adnan Akram.
>

Pleeeease need help in SQL Server Database Hosting?

I am using a SQL Server 2000 Database for the purpose of development.

Now I want to host the SQL Server2000 database in the internet and I want to access it via the ASP.Net

1) Please, what is the best server that host SQL Server databases?
2) And Can I control the database remotely(such as execute srcipt to change table structure in the hosted database) as I did in Query Analyzer?
3) Is the administer of the hosting server able to change the strucure and contents of My Hosted DataBase?

Please send me an example if you havehttp://www.devarticles.com/c/a/ASP/Two-Ways-To-Connect-To-SQL-Server-2000-Via-ASP/1/ for reference.

http://sqljunkies.com/Newsgroups/microsoft.public.sqlserver.connect/2004/4/8/158816.aspx for more information.

Please help! SQL Server2000 Performance in RAID0.

Dear All,
I have a high end server that OS isWin20000 Server is RAID0 with three
SCSI 30G Harddisk (10000rpm). Intel CPU 3.GHz with 2G RAM.
Also, I have a pc that is 1.7G Hz with a 40G IDE (7200 rpm), 1G RAM. The pc
also install SQL Server 2000.
I install MSSQL 2000 in both High end server and the pc.
I try to write the same set of data to Both SQL Server, the writing speed
of High end server is slower than my pc that just a single IDE 40G harddisk,
Intel 1.7GHz.
Why'
Actaully in the High end server, when I monitor to the CPU, Memory in the
system monitor, all are really ok. CPU utilization is really low and the
Memory is enough.
So, I am really no idea to solve it.
Actually, when I create the logical drive in RAID 0, It allows me to set
the Strip size. I just select it by default size.
What is the meaning of "Strip size"? How to determine that value?
Is that reason to make the writing speed so slow?
It make me very surprised. Any suggestion?
--
Regards,
Anthony LamFirst, you're not comparing apples to apples. Different
things have different overhead, and that all ties back to
configuration too.
RAID 0 is an odd choice for SQL Server ... RAID 1, RAID
10, or RAID 5 are common (depending on usage), but not
plain RAID 0. SO that may be part of it.
Beyond that, you should format the disks with 64k clusters
at a low level as well as in NTFS. That will make the
data disks optimized for SQL Server.
>--Original Message--
>Dear All,
> I have a high end server that OS isWin20000 Server is
RAID0 with three
>SCSI 30G Harddisk (10000rpm). Intel CPU 3.GHz with 2G
RAM.
>Also, I have a pc that is 1.7G Hz with a 40G IDE (7200
rpm), 1G RAM. The pc
>also install SQL Server 2000.
>I install MSSQL 2000 in both High end server and the pc.
>I try to write the same set of data to Both SQL Server,
the writing speed
>of High end server is slower than my pc that just a
single IDE 40G harddisk,
>Intel 1.7GHz.
>Why'
>Actaully in the High end server, when I monitor to the
CPU, Memory in the
>system monitor, all are really ok. CPU utilization is
really low and the
>Memory is enough.
>So, I am really no idea to solve it.
>Actually, when I create the logical drive in RAID 0, It
allows me to set
>the Strip size. I just select it by default size.
>What is the meaning of "Strip size"? How to determine
that value?
>Is that reason to make the writing speed so slow?
>It make me very surprised. Any suggestion?
>--
>Regards,
>Anthony Lam
>
>.
>

Please help! SQL Server2000 Performance

Dear all,
I have a high end server that OS isWin20000 Server is RAID0 with three
SCSI 30G Harddisk (10000rpm). Intel CPU 3.GHz with 2G RAM.
Also, I have a pc that is 1.7G Hz with a 40G IDE (7200 rpm), 1G RAM. The pc
also install SQL Server 2000.
I install MSSQL 2000 in both High end server and the pc.
I try to write the same set of data to Both SQL Server, the writing speed
of High end server is slower than my pc that just a single IDE 40G harddisk,
Intel 1.7GHz.
Why'
It make me very surprised. Any suggestion?
--
Regards,
Anthony LamAre you 100% certain that you have RAID0 and not RAID5?
--
Tibor Karaszi, SQL Server MVP
Archive at:
http://groups.google.com/groups?oi=djq&as_ugroup=microsoft.public.sqlserver
"AA" <anthony@.jadeflex.com> wrote in message
news:OThRpq8vDHA.2352@.TK2MSFTNGP09.phx.gbl...
> Dear all,
> I have a high end server that OS isWin20000 Server is RAID0 with three
> SCSI 30G Harddisk (10000rpm). Intel CPU 3.GHz with 2G RAM.
> Also, I have a pc that is 1.7G Hz with a 40G IDE (7200 rpm), 1G RAM. The
pc
> also install SQL Server 2000.
> I install MSSQL 2000 in both High end server and the pc.
> I try to write the same set of data to Both SQL Server, the writing speed
> of High end server is slower than my pc that just a single IDE 40G
harddisk,
> Intel 1.7GHz.
> Why'
> It make me very surprised. Any suggestion?
> --
> Regards,
> Anthony Lam
>|||Try running the System Monitor utility & try to identify where the
bottleneck is on your server. You can find it under Start / Programs / Admin
Tools / System Monitor.
You might get some useful information from a simple trace on CPU, Memory &
Physical Disk queues..
How are you submitting your workloads to these machines? Are you logged on
to the console of both machines individually, or are you sending commands to
the server from the PC (using the network) perhaps?
Then there are many database settings which might be in play as well.
This might give you a few extra ideas though..
HTH
Regards,
Greg Linwood
SQL Server MVP
"AA" <anthony@.jadeflex.com> wrote in message
news:OThRpq8vDHA.2352@.TK2MSFTNGP09.phx.gbl...
> Dear all,
> I have a high end server that OS isWin20000 Server is RAID0 with three
> SCSI 30G Harddisk (10000rpm). Intel CPU 3.GHz with 2G RAM.
> Also, I have a pc that is 1.7G Hz with a 40G IDE (7200 rpm), 1G RAM. The
pc
> also install SQL Server 2000.
> I install MSSQL 2000 in both High end server and the pc.
> I try to write the same set of data to Both SQL Server, the writing speed
> of High end server is slower than my pc that just a single IDE 40G
harddisk,
> Intel 1.7GHz.
> Why'
> It make me very surprised. Any suggestion?
> --
> Regards,
> Anthony Lam
>|||Actaully, when I monitor to the CPU, Memory ...in the system monitor, all
are really ok. CPU utilization is really low and the Memory is enough.
So, I am really no idea to solve it.
Actually, when I create the RAID 0, It allows me to set the Strip size. I
just select default size.
What is the meaning of "Strip size"? How to determine that value?
Is that reason to make the writing speed so slow?
Anthony
"Greg Linwood" <g_linwoodremovethisbeforeemailingme@.hotmail.com> ¦b¶l¥ó
news:eOEkbb9vDHA.2448@.TK2MSFTNGP09.phx.gbl ¤¤¼¶¼g...
> Try running the System Monitor utility & try to identify where the
> bottleneck is on your server. You can find it under Start / Programs /
Admin
> Tools / System Monitor.
> You might get some useful information from a simple trace on CPU, Memory &
> Physical Disk queues..
> How are you submitting your workloads to these machines? Are you logged on
> to the console of both machines individually, or are you sending commands
to
> the server from the PC (using the network) perhaps?
> Then there are many database settings which might be in play as well.
> This might give you a few extra ideas though..
> HTH
> Regards,
> Greg Linwood
> SQL Server MVP
> "AA" <anthony@.jadeflex.com> wrote in message
> news:OThRpq8vDHA.2352@.TK2MSFTNGP09.phx.gbl...
> > Dear all,
> > I have a high end server that OS isWin20000 Server is RAID0 with
three
> > SCSI 30G Harddisk (10000rpm). Intel CPU 3.GHz with 2G RAM.
> > Also, I have a pc that is 1.7G Hz with a 40G IDE (7200 rpm), 1G RAM.
The
> pc
> > also install SQL Server 2000.
> > I install MSSQL 2000 in both High end server and the pc.
> > I try to write the same set of data to Both SQL Server, the writing
speed
> > of High end server is slower than my pc that just a single IDE 40G
> harddisk,
> > Intel 1.7GHz.
> >
> > Why'
> > It make me very surprised. Any suggestion?
> >
> > --
> > Regards,
> >
> > Anthony Lam
> >
> >
>|||Hi - sorry I've missed answering this earlier.
This is quite rudimentary analysis, but if you're observations re memory &
cpu are correct, then it suggests that you've got a i/o bound performance
problem. Sorting this type of problem out can be confusing at first as the
root cause can be in a few places & not necessarily at the hardware layer.
First, you may have a physical design problem - something simple such as a
poorly chosen clustered index which causes page splits during the insert
operations (page splits can cause excessive i/o). Then again, it could be at
the hardware configuration level such as disk configuration. There are a
variety of potential problems in this area, including stripe size.
Before launching much further into analysis with RAID configuration, can you
confirm that you're actually using hardware raid? Or are you using Windows
raid? You didn't give much info about what raid you're using. I'm
suspecting hardware raid, given that you're not seeing high cpu utilization,
but the whole picture changes if you're using WIndows raid (generally not a
good idea). Hardware raid nearly always out performs software raid.
Stripe size is the number of blocks in each stripe accross the striped set
of disks. This is commonly referred to in either pure # of blocks & also kb.
The ideal stripe size depends on various things, including number, speed &
size of disk spindles, controller cache & perhaps most importantly useage
patterns. This is too much of a complex topic for me to easily summarise for
you in a single post, so I suggest that you do some research, but my
experience is that anything from 8k - 64k (commony default for Windows &
many controllers) is good for SQL Server. 64k is an allocation size for SQL
Server which is often good for data acquisition type applications as table
spaces are written in 64k "extents'.
HTH
Regards,
Greg Linwood
SQL Server MVP
"AA" <anthony_lam@.iname.com> wrote in message
news:uB67YRAwDHA.2880@.tk2msftngp13.phx.gbl...
> Actaully, when I monitor to the CPU, Memory ...in the system monitor, all
> are really ok. CPU utilization is really low and the Memory is enough.
> So, I am really no idea to solve it.
> Actually, when I create the RAID 0, It allows me to set the Strip size. I
> just select default size.
> What is the meaning of "Strip size"? How to determine that value?
> Is that reason to make the writing speed so slow?
> Anthony
>
> "Greg Linwood" <g_linwoodremovethisbeforeemailingme@.hotmail.com> ¦b¶l¥ó
> news:eOEkbb9vDHA.2448@.TK2MSFTNGP09.phx.gbl ¤¤¼¶¼g...
> > Try running the System Monitor utility & try to identify where the
> > bottleneck is on your server. You can find it under Start / Programs /
> Admin
> > Tools / System Monitor.
> >
> > You might get some useful information from a simple trace on CPU, Memory
&
> > Physical Disk queues..
> >
> > How are you submitting your workloads to these machines? Are you logged
on
> > to the console of both machines individually, or are you sending
commands
> to
> > the server from the PC (using the network) perhaps?
> >
> > Then there are many database settings which might be in play as well.
> >
> > This might give you a few extra ideas though..
> >
> > HTH
> >
> > Regards,
> > Greg Linwood
> > SQL Server MVP
> >
> > "AA" <anthony@.jadeflex.com> wrote in message
> > news:OThRpq8vDHA.2352@.TK2MSFTNGP09.phx.gbl...
> > > Dear all,
> > > I have a high end server that OS isWin20000 Server is RAID0 with
> three
> > > SCSI 30G Harddisk (10000rpm). Intel CPU 3.GHz with 2G RAM.
> > > Also, I have a pc that is 1.7G Hz with a 40G IDE (7200 rpm), 1G RAM.
> The
> > pc
> > > also install SQL Server 2000.
> > > I install MSSQL 2000 in both High end server and the pc.
> > > I try to write the same set of data to Both SQL Server, the writing
> speed
> > > of High end server is slower than my pc that just a single IDE 40G
> > harddisk,
> > > Intel 1.7GHz.
> > >
> > > Why'
> > > It make me very surprised. Any suggestion?
> > >
> > > --
> > > Regards,
> > >
> > > Anthony Lam
> > >
> > >
> >
> >
>