View by Category

Presentations

Products
Sold on our sister site CrystalGraphics.com

About This Presentation

Write a Comment

User Comments (0)

Transcript and Presenter's Notes

Sparse matrix data structure

- Typically eitherCompressed Sparse Row

(CSR)orCompressed Sparse Column (CSC) - Informally ia-ja format
- CSR is better for matrix-vector multiplies CSC

can be better for factorization - CSR
- Array of all values, row by row
- Array of all column indices, row by row
- Array of pointers to start of each row

Direct Solvers

- Well just peek at Cholesky factorization of SPD

matrices ALLT - In particular, pivoting not required!
- Modern solvers break Cholesky into three phases
- Ordering determine order of rows/columns
- Symbolic factorization determine sparsity

structure of L in advance - Numerical factorization compute values in L
- Allows for much greater optimization

Graph model of elimination

- Take the graph whose adjacency matrix matches A
- Choosing node i to eliminate next in

row-reduction - Subtract off multiples of row i from rows of

neighbours - In graph terms unioning edge structure of i with

all its neighbours - A is symmetric -gt connecting up all neighbours of

i into a clique - New edges are called fill(nonzeros in L that

are zero in A) - Choosing a different sequence can result in

different fill

Extreme fill

- The star graph
- If you order centre last, zero fill O(n) time

and memory - If you order centre first, O(n2) fill O(n3)

time and O(n2) memory

Fill-reducing orderings

- Finding minimum fill ordering is NP-hard
- Two main heuristics in use
- Minimum Degree (greedy incremental)choose node

of minimum degree first - Without many additional accelerations, this is

too slow, but now very efficient e.g. AMD - Nested Dissection (divide-and-conquer)partition

graph by a node separator, order separator last,

recurse on components - Optimal partition is also NP-hard, but very

good/fast heuristic exist e.g. Metis - Great for parallelism e.g. ParMetis

A peek at Minimum Degree

- See George Liu, The evolution of the minimum

degree algorithm - A little dated now, but most of key concepts

explained there - Biggest optimization dont store structure

explicitly - Treat eliminated nodes as quotient nodes
- Edge in L path in A via zero or more eliminated

nodes

A peek at Nested Dissection

- Core operation is graph partitioning
- Simplest strategy breadth-first search
- Can locally improve with Kernighan-Lin
- Can make this work fast by going multilevel

Theoretical Limits

- In 2D (planar or near planar graphs), Nested

Dissection is within a constant factor of

optimal - O(n log n) fill (nnumber of nodes - think s2)
- O(n3/2) time for factorization
- Result due to Lipton Tarjan
- In 3D asymptotics for well-shaped 3D meshes is

worse - O(n5/3) fill (nnumber of nodes - think s3)
- O(n2) time for factorization
- Direct solvers are very competitive in 2D, but

dont scale nearly as well in 3D

Symbolic Factorization

- Given ordering, determining L is also just a

graph problem - Various optimizations allow determination of row

or column counts of L in nearly O(nnz(A)) time - Much faster than actual factorization!
- One of the most important observationsgood

orderings usually results in supernodes columns

of L with identical structure - Can treat these columns as a single block column

Numerical Factorization

- Can compute L column by column with left-looking

factorization - In particular, compute a supernode (block column)

at a time - Can use BLAS level 3 for most of the numerics
- Get huge performance boost, near optimal

Software

- See Tim Daviss list atwww.cise.ufl.edu/research/

sparse/codes/ - Ordering AMD and Metis becoming standard
- Cholesky PARDISO, CHOLMOD,
- General PARDISO, UMFPACK,

About PowerShow.com

PowerShow.com is a leading presentation/slideshow sharing website. Whether your application is business, how-to, education, medicine, school, church, sales, marketing, online training or just for fun, PowerShow.com is a great resource. And, best of all, most of its cool features are free and easy to use.

You can use PowerShow.com to find and download example online PowerPoint ppt presentations on just about any topic you can imagine so you can learn how to improve your own slides and presentations for free. Or use it to find and download high-quality how-to PowerPoint ppt presentations with illustrated or animated slides that will teach you how to do something new, also for free. Or use it to upload your own PowerPoint slides so you can share them with your teachers, class, students, bosses, employees, customers, potential investors or the world. Or use it to create really cool photo slideshows - with 2D and 3D transitions, animation, and your choice of music - that you can share with your Facebook friends or Google+ circles. That's all free as well!

For a small fee you can get the industry's best online privacy or publicly promote your presentations and slide shows with top rankings. But aside from that it's free. We'll even convert your presentations and slide shows into the universal Flash format with all their original multimedia glory, including animation, 2D and 3D transition effects, embedded music or other audio, or even video embedded in slides. All for free. Most of the presentations and slideshows on PowerShow.com are free to view, many are even free to download. (You can choose whether to allow people to download your original PowerPoint presentations and photo slideshows for a fee or free or not at all.) Check out PowerShow.com today - for FREE. There is truly something for everyone!

You can use PowerShow.com to find and download example online PowerPoint ppt presentations on just about any topic you can imagine so you can learn how to improve your own slides and presentations for free. Or use it to find and download high-quality how-to PowerPoint ppt presentations with illustrated or animated slides that will teach you how to do something new, also for free. Or use it to upload your own PowerPoint slides so you can share them with your teachers, class, students, bosses, employees, customers, potential investors or the world. Or use it to create really cool photo slideshows - with 2D and 3D transitions, animation, and your choice of music - that you can share with your Facebook friends or Google+ circles. That's all free as well!

For a small fee you can get the industry's best online privacy or publicly promote your presentations and slide shows with top rankings. But aside from that it's free. We'll even convert your presentations and slide shows into the universal Flash format with all their original multimedia glory, including animation, 2D and 3D transition effects, embedded music or other audio, or even video embedded in slides. All for free. Most of the presentations and slideshows on PowerShow.com are free to view, many are even free to download. (You can choose whether to allow people to download your original PowerPoint presentations and photo slideshows for a fee or free or not at all.) Check out PowerShow.com today - for FREE. There is truly something for everyone!

presentations for free. Or use it to find and download high-quality how-to PowerPoint ppt presentations with illustrated or animated slides that will teach you how to do something new, also for free. Or use it to upload your own PowerPoint slides so you can share them with your teachers, class, students, bosses, employees, customers, potential investors or the world. Or use it to create really cool photo slideshows - with 2D and 3D transitions, animation, and your choice of music - that you can share with your Facebook friends or Google+ circles. That's all free as well!

For a small fee you can get the industry's best online privacy or publicly promote your presentations and slide shows with top rankings. But aside from that it's free. We'll even convert your presentations and slide shows into the universal Flash format with all their original multimedia glory, including animation, 2D and 3D transition effects, embedded music or other audio, or even video embedded in slides. All for free. Most of the presentations and slideshows on PowerShow.com are free to view, many are even free to download. (You can choose whether to allow people to download your original PowerPoint presentations and photo slideshows for a fee or free or not at all.) Check out PowerShow.com today - for FREE. There is truly something for everyone!

For a small fee you can get the industry's best online privacy or publicly promote your presentations and slide shows with top rankings. But aside from that it's free. We'll even convert your presentations and slide shows into the universal Flash format with all their original multimedia glory, including animation, 2D and 3D transition effects, embedded music or other audio, or even video embedded in slides. All for free. Most of the presentations and slideshows on PowerShow.com are free to view, many are even free to download. (You can choose whether to allow people to download your original PowerPoint presentations and photo slideshows for a fee or free or not at all.) Check out PowerShow.com today - for FREE. There is truly something for everyone!

Recommended

«

/ »

Page of

«

/ »

Promoted Presentations

Related Presentations

Page of

Home About Us Terms and Conditions Privacy Policy Presentation Removal Request Contact Us Send Us Feedback

Copyright 2018 CrystalGraphics, Inc. — All rights Reserved. PowerShow.com is a trademark of CrystalGraphics, Inc.

Copyright 2018 CrystalGraphics, Inc. — All rights Reserved. PowerShow.com is a trademark of CrystalGraphics, Inc.

The PowerPoint PPT presentation: "Sparse matrix data structure" is the property of its rightful owner.

Do you have PowerPoint slides to share? If so, share your PPT presentation slides online with PowerShow.com. It's FREE!